Panoply.io - A blog about data management and data infrastructure

Technical insights and creative ideas about data management, data infrastructure, and data analysis.

Subscribe to our emails and get Panoply updates on the fly.

Being Data Driven Data Technology

Data Warehouses Vs Data Virtualization—and the Winner is...

Data analytics allows organizations to gain insight into their business operations and find new ways to increase their revenue. However, the data sources used to provide these insights are often....

[+]
Written by An Bui |December 12, 2017

Data Technology

Data Warehouse Design: The Good, the Bad, the Ugly

Good Business Intelligence (BI), allows your organization to query data obtained from trusted sources and use the answers to gain a competitive edge in your industry. The first step to achieving....

[+]
Written by An Bui |November 28, 2017

Being Data Driven Data Technology

Data Warehouse or Data Lake: How to Select the Right Solution

Data warehouses and data lakes are two different types of data storage repositories. Data warehouses integrate data from various sources and structures them for business reporting. Data lakes....

[+]
Written by An Bui |November 21, 2017

Data Technology

Database or Data Warehouse - Which is Right For You?

The future of any successful enterprise will hinge on its ability to harness and use massive amounts of data currently available, to improve productivity, decrease costs, and increase profits. How....

[+]
Written by An Bui |November 07, 2017

From raw data to analysis in under 10 minutes.

Sign up now for a demo or a free trail of the Panoply.io platform.

Learn more about platform features

Data Technology

PostgreSQL vs. MariaDB

PostgreSQL and MariaDB are open source databases, which boast of vast community support and development, as well as enterprise versions. While PostgreSQL has withstood time and continued....

[+]
Written by Cheryl Adams |October 31, 2017

Being Data Driven Data Technology

Joint Analytics with Power BI and Azure

Business Intelligence (BI) has, by tradition, been a long and drawn out process. In the early days of computers, BI tools such as SAP/Crystal Reports and IBM/Cognos came along to speed things up.....

[+]
Written by Cheryl Adams |October 24, 2017

Being Data Driven Data Technology

Connecting to Data Warehouses in Tableau

Is it easy to connect to a data warehouse? Selecting the right tool can help make this connection attainable. Tableau Desktop makes this connection easy, from opening the software to connecting to....

[+]
Written by Cheryl Adams |October 05, 2017

Data Technology

Redshift Pricing: A Data Engineer's Guide

Although there are several data warehousing systems on the market, Amazon Redshift and Google BigQuery are the industry behemoths. There is a “prevailing consensus that Amazon is leading the pack.....

[+]
Written by Alon Brody |July 06, 2017

Data Technology

CouchDB vs MongoDB

Whether your database needs to run on a mobile device or scale to a humongous size, this post has you covered with CouchDB vs. MongoDB. One of these databases can run on your phone while the other....

[+]
Written by Matan Sarig |June 12, 2017

Data Technology

Redis vs MongoDB

The battle of the NoSQL databases continues. We first analyzed Cassandra vs MongoDB. This time we will dig in Redis vs MongoDB.

[+]
Written by Matan Sarig |May 29, 2017

Data Technology

Redshift Data Types. Day to Day Challenges.

Let's talk about data. The sheer volume of the data collected today is enormous. When I try to even imagine the amounts ... it's staggering.

[+]
Written by Alon Brody |May 15, 2017

Data Technology

Cassandra vs MongoDB

When it comes to NoSQL databases, MongoDB and Cassandra may seem similar but are actually quite different. Both have similar use cases, but are not intended for transactional data (i.e. accounting....

[+]
Written by Matan Sarig |May 08, 2017

Data Technology

Redshift Query Queues: The Complete Guide

Setting up a Redshift cluster that hangs on some number of query executions is always a hassle. When users run queries in Amazon Redshift, the queries are routed to query queues. Usually the....

[+]
Written by Alon Brody |April 25, 2017

Data Technology

AWS Spectrum, Athena and S3: Everything You Need to Know

Yesterday at AWS San Francisco Summit, Amazon announced a powerful new feature - Redshift Spectrum. Spectrum offers a set of new capabilities that allow Redshift users to seamlessly query....

[+]
Written by Roi Avinoam |April 21, 2017

Data Industry and Trends Data Technology

Amazon Athena Does Battle: Comparing Athena and Redshift

Data warehouse technologies are advancing towards interactive, real-time, and analytical solutions. In particular, cloud-based data warehouse technologies have reached new heights with the help of....

[+]
Written by Alon Brody |April 18, 2017

Data Technology

MongoDB vs MySQL: the differences explained

MySQL has become an inexpensive option for organizations around the globe that need a relational database. However, as the variety and volume of data has increased in recent years, non-relational....

[+]
Written by Matan Sarig |April 10, 2017

Data Technology

Lessons Learned From the Recent Amazon S3 Outage

On Feb 28th, Amazon Web Services (AWS), went down for approximately 4 hours. The outage occurred in Amazon’s US-East-1 facility in Virginia, their biggest region, and disrupted business continuity....

[+]
Written by Yaniv Leven |March 30, 2017

Data Technology

MariaDB vs MySQL. A Comparative

Healthy competition can bring out the best in organizations. Just look at companies like Coke and Pepsi or General Motors and Ford, all of which were obsessed with outdoing the other while the....

[+]
Written by Matan Sarig |March 28, 2017

Product Data Technology

Introducing Panoply Multi Zone Redshift Service

Today’s considered data management best practices, advocate building resilient architectures that span multiple data centers, regions or even continents.

[+]
Written by Roi Avinoam |March 02, 2017

Data Technology

Redshift Security - Encrypting Loads with S3/KMS/Lambda

One of the main goals of this blog is to help developers and data architects, just like us, with their Amazon Redshift operations. Starting from a full comparison with Google BigQuery, explaining....

[+]
Written by Alon Brody |February 22, 2017

Data Technology

11 Great ETL Tools, and the Case for Saying “No” to ETL

Extract, Transform, and Load (ETL) is a data warehousing process that uses batch processing to help business users analyze and report on data relevant to their business focus. The ETL process....

[+]
Written by Alon Brody |January 09, 2017

Data Industry and Trends Data Technology

Apache Spark: Promises and Challenges

If you’re looking for a solution for processing huge chuncks of data, then there are lots of options these days. Depending on your use case and the type of operations you want to perform on data,....

[+]
Written by Alon Brody |December 20, 2016

Data Technology

Redshift vs. BigQuery: The Full Comparison

As we speak the future of cloud computing is being decided. Amazon and Google, as well as Microsoft and a few others, offer multiple cloud solutions for practically everything. Despite the....

[+]
Written by Roi Avinoam |July 04, 2016

Being Data Driven Data Technology

Redshift Benchmark: A First Test of the Entire Data Funnel

Amazon Redshift is a very powerful data warehouse, optimized for analyzing massive amounts of data in a blink of a second, when configured right.

[+]
Written by Roi Avinoam |April 12, 2016

Being Data Driven Data Technology

Blitz Analyzing with Microsoft SandDance

Microsoft Research just released SandDance, a free web-based data visualization tool.

[+]
Written by Alon Brody |March 25, 2016