EU Data News @eudatatech-blog - Tumblr Blog

For those of you here for the TLDR, here ‘tis:

When we had to scale into billions of dollars of originations and multiple currencies at the same time here at Funding Circle, we chose…

Pyrostore is a real-time data storage product that lets you stream data forever.

Pyrostore uses cloud object stores to archive Kafka data and makes it easy to replay the archived data at a later date.

Do’s and don’ts of logging — from my accumulated experience working with log data.

In this blog post, I’ll look at MyRocks performance through some benchmark testing. As the MyRocks storage engine (based on the RocksDB key-value store ) is now available as part of Percona S…

Privacy-preserving analytics is not only possible, but with GDPR about to come online, it will become necessary to incorporate privacy in your data products.

Struggling to become analytics-driven? One or more of these issues is likely what’s holding your organization back.

Tammy Bütow was doing chaos engineering long before Netflix and its poo-throwing monkey gave a name to it. About a decade ago, she worked in a bank on a team that performed disaster recovery testing. But, instead of continuous automated testing, once a quarter hundreds of people crammed in a room and threw the kitchen …

#architecture

VisiData is a free, open-source tool that lets you quickly open, explore, summarize, and analyzedatasets in your computer’s terminal. VisiData works with CSV files, Excel spreadsheets, SQL databases, and many other data sources.

Having to take your application offline for updates can be a pain. You can mitigate this with consistent, scheduled downtime, but it’s not something that brings delight to customers. What’s more, some sites can lose thousands of dollars per minute they’re down. There are many reasons an app can go down, but deploying or upgrading your application shouldn’t be one of them! We have a tool we can use to ensure that our deployments create no downtime: blue/green deployments. What It Is: A Few Wonderful Colors I don’t know who originally decided to use the colors “blue” and “green.” But […]

What's new in Hadoop, and how is vendor dynamics and strategy evolving?

“you don't hear much about TCP/IP either, and that's because it's been there for a while and it just works “

Every single tech company that operates at a very large scale will tell you about the importance of knowing how to properly handle data…

This talk was presented to developers at Momentum Dev Con covering how to get started with Apache Airflow with examples of custom components like hooks, operators, executors, and plugins. We also cover example DAGs and the Astronomer CLI for Airflow. The talk abstract is available on the conference site (search

#python

What do you really know about how to monitor a Kafka cluster for problems? Is your most reliable monitoring your users telling you there’s something broken? Ar…

What myths surround event-driven architectures, and the truth behind the valuable solution that can provide agility and scalability for software engineers

The VideoAmp data engineering department was undergoing pivotal change last fall. The team at the time consisted of three data engineers…

Ooh, a Slack operator in Airflow that lets you alert on unexpectedness in a standard way. That’s a great idea!

In one of our previous blog posts on AIR Infrastructure, we had discussed the various data sources for AIR and the architecture for collecting these data f

Qubole’s experiences in introducing Airflow

Trending Blogs

Recently Viewed Blogs

EU Data News