Panoply.io - A blog about data management and data infrastructure

Being Data Driven

Subscribe to our emails and get Panoply updates on the fly.

Panoply Databases Being Data Driven

Why Shinesty Chose Panoply Over Snowflake & BigQuery: ease of use and speed to insights

Shinesty is among the quirkiest brands on the web. The company sells clothing, costumes and general fun for those who want to stand out at a party. One look at their website, Instagram feed or ....

[+]
Written by Jason Harris |July 17, 2018

Being Data Driven Big Data

Big Data as a Service: IaaS, PaaS and SaaS

Big Data as a Service (BDaaS) is a reality today. Increasing cloud usage, and new cloud services, mean you can set up big data infrastructure that just works—without maintaining servers and with....

[+]
Written by An Bui |June 26, 2018

Being Data Driven Customer Stories

Becoming Data-Driven with Self-Serve Analytics at Motorsport.com

Motorsport.com is the premier destination for news and analysis on all things racing. From IndyCar to Formula 1 to NASCAR, Motorsport.com covers racing by operating more than forty online media....

[+]
Written by Jason Harris |June 04, 2018

Being Data Driven

Big Data Management: 5 Key Points to Remember

The idea is pretty simple - the more you have of something, the more challenging it is to manage. This absolutely holds true when it comes to data. Today, we’re seeing the “datafication” of the....

[+]
Written by An Bui |May 29, 2018

From raw data to analysis in under 10 minutes.

Sign up now for a demo or a free trail of the Panoply.io platform.

Learn more about platform features

Being Data Driven

Data Warehousing Concepts: Everything You Need to Know in 4 Minutes

Just ten years ago, even the most advanced analytics professionals only had to manage a handful of data sources. But data volume, velocity, and variety are now increasing exponentially. In 2016,....

[+]
Written by An Bui |May 16, 2018

Being Data Driven

10 Questions to Help Define a Successful Data Warehouse Strategy

When defining your data warehouse strategy—or moving from on-premise to cloud—you’ve got lots of options. But your data warehouse is only as good as the strategy you use to put it in place. Bottom....

[+]
Written by An Bui |May 10, 2018

Being Data Driven Data Technology

Business Intelligence and Data Warehousing Meet: Magic Ensues

Humans are visually-motivated. When we see a movie, we’re drawn to the most beautiful and exotic settings, the most striking and recognizable actors, the biggest explosions. What we don’t spend a....

[+]
Written by An Bui |April 19, 2018

Being Data Driven

Becoming an analytics driven organization: challenge accepted

Both business and tech analysts agree that a capacity for advanced analytics is becoming mission-critical to the basic viability for all companies. While some believe that we are only three to....

[+]
Written by An Bui |April 11, 2018

Being Data Driven Customer Stories

How Justin Mulvaney at Spacious Saves Time With Panoply

Meet Justin Mulvaney, he’s the data analyst at Spacious, a company based in New York City. We recently sat down with Justin to talk about his background, how he serves the data needs of a....

[+]
Written by Jason Harris |April 04, 2018

Being Data Driven

Build vs. Buy Analysis: how much will that cloud data warehouse cost?

Build vs. Buy—tale as old as time, song as old as…"I need that analysis yesterday!"

[+]
Written by An Bui |March 30, 2018

Being Data Driven

Stay Informed in the Panoply Community

We’re making a new resource available to Panoply customers and users. We call it our Community, and one click over there and you’ll see it is a forum.To break down the elements of using Panoply -....

[+]
Written by Jason Harris |March 27, 2018

Data Industry and Trends Being Data Driven

Women Who Kick @$$ in Data Analysis, Science and Engineering

International Women's Day is a day when women are recognized for their achievements without regard to divisions, whether national, ethnic, linguistic, cultural, economic or political.

As we....

[+]
Written by An Bui |March 07, 2018

Being Data Driven

The Worst Advice We’ve Ever Heard About ETL

ETL. It should be fairly straightforward, right? We extract data, transform it as needed, and load it into the target application. But like the recipe for the perfect Bloody Mary or the ideal....

[+]
Written by An Bui |February 27, 2018

Being Data Driven

9 Things Your Boss Wants to Know About Data Warehousing

As an analyst who deals with data from many data sources daily, you might find yourself as the go-to source for information about business intelligence in your office. While it’s cute when your....

[+]
Written by An Bui |February 07, 2018

Being Data Driven

Get Stacked: Designing a High Performance, High ROI Data Stack

Your company sits on an immense treasure trove of data, but tapping this data and accessing its value is a challenge. As your company grew or new software solutions became available, your business....

[+]
Written by An Bui |January 30, 2018

Being Data Driven Data Technology

Redshift Benchmark: A First Test of the Entire Data Funnel

Amazon Redshift is a very powerful data warehouse, optimized for analyzing massive amounts of data in a blink of a second, when configured right.

[+]
Written by Roi Avinoam |January 24, 2018

Being Data Driven

A Marketing Professional's Guide to Collecting Twitter Data

As a member of the marketing team you already know that data is power. However, it’s not always easy to get, and even when you can get the data you need, it’s not always easy to understand,....

[+]
Written by An Bui |January 19, 2018

Being Data Driven

ETL vs ELT: The Difference is in the How

For the last couple of decades ETL (extract, transform, load) has been the traditional approach for data warehousing and analytics. The ELT (extract, load, transform) approach changes the old....

[+]
Written by Roi Avinoam |January 17, 2018

Being Data Driven

How to Move Your MySQL to Redshift

 

Data analytics is a requirement for virtually every business today. However building an analytical data warehouse requires vast computing power to maintain performance and quick retrieval of....

[+]
Written by Roi Avinoam |January 10, 2018

Being Data Driven Data Technology

Enterprise Data Warehousing vs Data Virtualization: The Battle

Data analytics allows organizations to gain insight into their business operations and find new ways to increase their revenue. However, the data sources used to provide these insights are often....

[+]
Written by An Bui |December 12, 2017

Being Data Driven Data Technology

Data Warehouse or Data Lake: How to Select the Right Solution

Data warehouses and data lakes are two different types of data storage repositories. Data warehouses integrate data from various sources and structures them for business reporting. Data lakes....

[+]
Written by An Bui |November 21, 2017

Being Data Driven Data Technology

Embedded Analytics with Power BI and Azure

Business Intelligence (BI) has, by tradition, been a long and drawn out process. In the early days of computers, BI tools such as SAP/Crystal Reports and IBM/Cognos came along to speed things up.....

[+]
Written by Cheryl Adams |October 24, 2017

Being Data Driven Data Technology

Connecting to Data Warehouses in Tableau

Is it easy to connect to a data warehouse? Selecting the right tool can help make this connection attainable. Tableau Desktop makes this connection easy, from opening the software to connecting to....

[+]
Written by Cheryl Adams |October 05, 2017

Data Industry and Trends Being Data Driven

The Basics of Automated Data Warehouse Lifecycle Management

In the past, designing a data warehouse and data warehouse architecture has taken too long to complete. Executing numerous semi-automated steps results in a data warehouse that was limited and....

[+]
Written by Cheryl Adams |October 05, 2017

Data Industry and Trends Being Data Driven

How To Get People to Share Data

If you ask a group of big data analysts what are some of the top professional challenges they face, you can easily imagine which challenges are consistently shortlisted. One is the amount of time....

[+]
Written by Cheryl Adams |September 27, 2017

Being Data Driven

ELT vs. ETL by Design

The traditional approach for handling data warehousing as an analytical task has been Extact , Transform, and Load (ETL). However, in recent years, there has been an explosion in the types and....

[+]
Written by Cheryl Adams |September 19, 2017

Data Industry and Trends Being Data Driven

Data Management Best Practices for Cloud Computing

As more organizations begin their journey to the cloud, they need to plan how they will apply the best practices of data management to ensure that cloud-based, data-driven use cases are successful....

[+]
Written by Cheryl Adams |September 19, 2017

Data Industry and Trends Being Data Driven

Top 10 Questions to Ask When Selecting a Big Data Solution

Long before there was big data, there were computing solutions designed to store, organize, and analyze data. But just like the job of a big data architect, it's both bigger and different than ....

[+]
Written by Cheryl Adams |September 05, 2017

Being Data Driven

The Organization of Data Management

Designing a database schema is the first step in building a foundation in data management. Ineffective schema design can creates databases that are heavy consumers of memory and other resources,....

[+]
Written by Cheryl Adams |August 31, 2017

Data Industry and Trends Being Data Driven

How To Become a Big Data Architect: A Guide

Organizations looking to leverage big data impose a larger and different set of job requirements on their data architects versus organizations in traditional environments.

[+]
Written by Cheryl Adams |August 24, 2017

Data Industry and Trends Being Data Driven

4 Skills Required to Become an Outstanding Data Engineer

A data engineer conceives, builds and maintains the data infrastructure that holds your enterprise’s advanced analytics capacities together.  

[+]
Written by Yaniv Leven |June 08, 2017

Data Industry and Trends Being Data Driven

How To Become A Data Engineer: A Guide

The demand for skilled Data Engineers (or Big Data Engineers) is projected to rapidly grow.  No wonder that’s the case: no matter what your company does, to succeed in today’s competitive....

[+]
Written by Yaniv Leven |April 27, 2017

Being Data Driven

Five Data Tasks That Keep Data Engineers Awake at Night

As a data engineer, I enjoy my work, but when it comes  to integrating and managing data  there are quite a few tasks that are downright tedious. From data remodeling to juggling a hodgepodge of....

[+]
Written by Yaniv Leven |March 23, 2017

Data Industry and Trends Being Data Driven

Which type of data warehouse is right for you?

I loved this line from an article I recently stumbled upon:  “Choosing between the different types of data warehouse platforms can be simplified once you know which deployment option best meets....

[+]
Written by Yaniv Leven |March 16, 2017

Being Data Driven

SQL vs NoSQL: The Differences Explained

We all know that in the database and data warehouse technology world, it comes down to two main database types – SQL (relational) and NoSQL (non-relational). The differences between them are....

[+]
Written by Alon Brody |March 09, 2017

Being Data Driven

Tableau & Redshift: How to Visualize Amazon Redshift Data

Data analyst? You must be familiar with both Tableau and AWS Redshift. And you must know, or at least you should believe me that integrating the Redshift columnar-based database speed with the....

[+]
Written by Alon Brody |February 08, 2017

Being Data Driven

Step-by-Step: Loading Data from Google Analytics to Redshift

The basic free Google Analytics (GA) functionality is great for small and medium websites and mobile applications, but as your online business expands, you will start looking to get more of this....

[+]
Written by Alon Brody |January 24, 2017

Being Data Driven

Data Augmentation: Bringing New Life to Your Data

If you recognize your data as an asset, than augmenting it simply means growing your business assets. With data augmentation, you can run manipulations on existing data, use multiple sources from....

[+]
Written by Yaniv Leven |December 13, 2016

Being Data Driven

A Business Intelligence Example: How to Prepare Data for Analysis

Preparing data for Business Intelligence (BI) can be a very tedious and time consuming process. You want the data to turn into the best reports for analysis. But, the raw data needs lots of....

[+]
Written by Alon Brody |November 01, 2016

Being Data Driven

Castles in the Cloud: Tips for Cloud Infrastructure

The cloud, unlike the Force, is not a mystical energy that surrounds us and binds us.

[+]
Written by Ken Saggy |August 15, 2016

Being Data Driven

Data Tools: How to Ace Product Evaluation

We often come across new products aiming to help us with our lives or improve our productivity. It’s in our best interests to find the best products that will minimize tedious work to none, but....

[+]
Written by Alon Brody |June 07, 2016

Data Industry and Trends Being Data Driven

Never judge a book by its cover: data infrastructure and data visualization, mutually exclusive or not?

This is the third and final part in the 101 series covering big data concepts, terminology and technology

[+]
Written by Moran Gilad Halevi |May 23, 2016

Being Data Driven

Data Dithering: How White Noise Can Improve Data Importing

Data and music have much in common given that both tell stories with points and notes, yet each on its own lacks the coherence and context that distinguishes music from noise. Paradoxically, in....

[+]
Written by Alon Weissfeld |May 09, 2016

Being Data Driven

Handling and Constructing JSON Semi-Structured Data Models

The byproduct of the ever increasing integration of the internet in our daily lives is massive growth of data transitioning between applications and servers every minute. In order to make these....

[+]
Written by Oshri Bienhaker |April 25, 2016

Being Data Driven Product

Introducing Panoply.io’s Upsert Mechanism

One of the most critical issue in data warehouse management is avoiding duplications. When you are periodically loading data into your data warehouse you will want to skip the rows that have been....

[+]
Written by Alon Brody |March 28, 2016

Being Data Driven Data Technology

Blitz Analyzing with Microsoft SandDance

Microsoft Research just released SandDance, a free web-based data visualization tool.

[+]
Written by Alon Brody |March 25, 2016

Being Data Driven

Data Warehouse Automation. A Question of When Not If

The premise that to build a perfect data warehouse you must have perfect business understanding is simply irrelevant. We must look to technology to empower us to keep pace with our rapidly....

[+]
Written by Yaniv Leven |March 14, 2016

Being Data Driven

How Data Structures Impact the Data Warehouse

This is the second part in a 101 series covering Big Data concepts, terminology and technology.

[+]
Written by Moran Gilad Halevi |February 29, 2016

Being Data Driven

The fallacy of One Data Technology to Rule Them All

As a species we’ve invented some pretty nifty things. It’s practically consensus that the wheel, the printing press and the internet top the list but we don’t need to look that far back to find....

[+]
Written by Roi Avinoam |February 16, 2016

Being Data Driven

Go Raw: Why Raw Data Reigns Supreme

ETL processes (extract, transform and load) might be fundamentally flawed.

[+]
Written by Alon Brody |February 01, 2016

Being Data Driven

Build KPIs not One Time Reports

Businesses need to deliver insights fast if not immediately. If this were not true, we would not be writing this post, you wouldn’t be reading it and over all, big data would be less of a diamond....

[+]
Written by Alon Brody |January 19, 2016

Being Data Driven

Data Warehouse What?

This is the first part in a 101 series covering Big Data concepts, terminology and technology. Starting with the data warehouse and data warehouse concepts.

[+]
Written by Moran Gilad Halevi |January 04, 2016