Long before there was big data, there were computing solutions designed to store, organize, and analyze data. But just like the job of a big data architect, it's both ...

Data Stack

Selecting a Big Data Solution: Top 10 Questions to Ask

By Cheryl Adams   |   September 5, 2017

Organizations looking to leverage big data impose a larger and different set of job requirements on their data architects versus organizations in traditional ...

Working in Data

How To Become a Big Data Architect: A Guide

By Cheryl Adams   |   August 24, 2017

We tend to take it for granted that big data is changing the world, but how exactly does that happen?

Working in Data

Data Engineer vs Data Scientist: Key Differences Explained

By James Konik   |   June 22, 2017

Whether your database needs to run on a mobile device or scale to a humongous size, this post has you covered with CouchDB vs. MongoDB. One of these databases can run on ...

Databases

CouchDB vs MongoDB

By Matan Sarig   |   June 12, 2017

A data engineer conceives, builds and maintains the data infrastructure that holds your enterprise’s advanced analytics capacities together.

Working in Data

4 Skills Required to Become an Outstanding Data Engineer

By Yaniv Leven   |   June 8, 2017

The battle of the NoSQL databases continues. We first analyzed Cassandra vs MongoDB. This time we will dig in Redis vs MongoDB.

Databases

Redis vs MongoDB

By Matan Sarig   |   May 29, 2017

In today’s fast-paced competitive market, there are critical advantages to utilizing infrastructure-as-a-service, especially for businesses concerned about fast-tracking ...

Data Industry Trends

The Rise of Infrastructure as a Service (IaaS)

By Yaniv Leven   |   May 25, 2017

Let's talk about data. The sheer volume of the data collected today is enormous. When I try to even imagine the amounts...it's staggering.

Data Warehousing

Redshift Data Types: Day To Day Challenges

By Alon Brody   |   May 15, 2017

Big Data can be a seductive master. How can you maximize time-to-insight without going over to the Dark Side?

Data Stack

What Star Wars Can Teach us about Analytics Infrastructure

By Yaniv Leven   |   May 4, 2017

The demand for skilled Data Engineers (or Big Data Engineers) is projected to rapidly grow. No wonder that’s the case: no matter what your company does, to succeed in ...

Working in Data

How To Become A Data Engineer: A Guide

By Yaniv Leven   |   April 27, 2017

Data warehouse technologies are advancing towards interactive, real-time, and analytical solutions. In particular, cloud-based data warehouse technologies have reached ...

Redshift

Athena vs Redshift: An Amazonian Battle or Performance and Scale

By Alon Brody   |   April 18, 2017

As a data engineer, I enjoy my work, but when it comes to integrating and managing data there are quite a few tasks that are downright tedious. From data remodeling to ...

Working in Data

What Do Data Engineers Do That Keeps Them Awake At Night

By Yaniv Leven   |   March 23, 2017

I loved this line from an article I recently stumbled upon: “Choosing between the different types of data warehouse platforms can be simplified once you know which ...

Data Warehousing

Which type of data warehouse is right for you?

By Yaniv Leven   |   March 16, 2017

One of the main goals of this blog is to help developers and data architects, just like us, with their Amazon Redshift operations, including Redshift security. Starting ...

Redshift

Redshift Security - Encrypting Loads with S3/KMS/Lambda

By Alon Brody   |   February 22, 2017

Data analyst? You must be familiar with both Tableau and AWS Redshift. And you must know, or at least you should believe me that integrating the Redshift columnar-based ...

Data Warehousing

Tableau & Redshift: How to Visualize Amazon Redshift Data

By Alon Brody   |   February 8, 2017

The basic free Google Analytics (GA) functionality is great for small and medium websites and mobile applications, but as your online business expands, you will start ...

Data Warehousing

Step-by-Step: Loading Data from Google Analytics to Redshift

By Alon Brody   |   January 24, 2017

Amazon re:Invent is a great place to gather feedback from industry professionals, and especially gauge cloud-industry trends. This past year, we used the opportunity to ...

Data Warehousing

Future Of Data Warehousing Is Cloud: This Survey Proves It

By Peter Gorne   |   January 18, 2017

Extract, Transform, and Load (ETL) is a data warehousing process that uses batch processing to help business users analyze and report on data relevant to their business ...

ETL/ELT

11 Great ETL Tools, and the Case for Saying “No” to ETL

By Alon Brody   |   January 9, 2017

If you’re looking for a solution for processing huge chuncks of data, then there are lots of options these days. Depending on your use case and the type of operations ...

Data Stack

Apache Spark Architecture, Use Cases and Issues

By Alon Brody   |   December 20, 2016

If you recognize your data as an asset, then augmenting it simply means growing your business assets. With data augmentation, you can run manipulations on existing data, ...

Data Stack

Data Augmentation: Bringing New Life to Your Data

By Yaniv Leven   |   December 13, 2016

The cloud, unlike the Force, is not a mystical energy that surrounds us and binds us.

Data Stack

Castles in the Cloud: Tips for Cloud Infrastructure

By Ken Saggy   |   August 15, 2016

We often come across new products aiming to help us with our lives or improve our productivity. It’s in our best interests to find the best products that will minimize ...

Data Stack

Data Tools: How to Ace Product Evaluation

By Alon Brody   |   June 7, 2016

This is the third and final part in the 101 series covering big data concepts, terminology and technology

BI and Data Visualization

Never judge a book by its cover: data infrastructure and data visualization, mutually exclusive or not?

By Moran Gilad Halevi   |   May 23, 2016

Data and music have much in common given that both tell stories with points and notes, yet each on its own lacks the coherence and context that distinguishes music from ...

Data Analysis

Data Dithering: How Noisy Data Can Improve Data Importing

By Alon Weissfeld   |   May 9, 2016

The byproduct of the ever increasing integration of the internet in our daily lives is massive growth of data transitioning between applications and servers every ...

Data Analysis

Handling and Constructing JSON Semi-Structured Data Models

By Oshri Bienhaker   |   April 25, 2016