Panoply.io - A blog about data management and data infrastructure

Technical insights and creative ideas about data management, data infrastructure, and data analysis.

Subscribe to our emails and get Panoply updates on the fly.

Data Industry and Trends

Big data is getting bigger

Every single day we, as a connected – mobile – workforce, are creating vast amounts of data. In fact, a recent Cisco report indicates that by 2020, data center storage installed capacity will grow....

[+]
Written by Bill Kleyman |October 17, 2017

Data Industry and Trends

ETL will it survive big data?

Managing big data is a never-ending challenge. Extract, transform, and load (ETL) processes serve as the traditional foundation for enterprise data warehousing. However, with the emerging....

[+]
Written by Cheryl Adams |October 17, 2017

Data Industry and Trends

How To Get People to Share Data

If you ask a group of big data analysts what are some of the top professional challenges they face, you can easily imagine which challenges are consistently shortlisted. One is the amount of time....

[+]
Written by Cheryl Adams |September 27, 2017

Data Industry and Trends

Top Cloud Security Threats, Risks, and Concerns

There are many risks involved with data security. Storing data in the cloud might seem like a safe bet, and for most users it is. But risks will always exist. Below we have identified some serious....

[+]
Written by Cheryl Adams |September 27, 2017

From raw data to analysis in under 10 minutes.

Sign up now for a demo or a free trail of the Panoply.io platform.

Learn more about platform features

Data Industry and Trends

Defining the Role of the Business Intelligence Architect

Are you considering a career as a BI Architect? You have made an excellent choice. Business Intelligence Architects are some of the leading minds in business and information management.

They use....

[+]
Written by Cheryl Adams |September 12, 2017

Data Industry and Trends

Top 10 Questions to Ask When Selecting a Big Data Solution

Long before there was big data, there were computing solutions designed to store, organize, and analyze data. But just like the job of a big data architect, it's both bigger and different than ....

[+]
Written by Cheryl Adams |September 05, 2017

Data Industry and Trends

How To Become a Great Big Data Architect

Organizations looking to leverage big data impose a larger and different set of job requirements on their data architects versus organizations in traditional environments.

[+]
Written by Cheryl Adams |August 24, 2017

Data Industry and Trends

Top 5 alternatives to MongoDB

When it comes to NoSQL databases, MongoDB is definitely in the lead as the world's fastest-growing database. But the days when a single database was enough are behind us;

[+]
Written by Yaniv Leven |June 15, 2017

Data Industry and Trends

4 Traits of Outstanding Data Engineers

A data engineer conceives, builds and maintains the data infrastructure that holds your enterprise’s advanced analytics capacities together.  

[+]
Written by Yaniv Leven |June 08, 2017

Data Industry and Trends

9 Must Attend Events for Data Engineers in 2017

To be an outstanding data engineer you must constantly keep up to date with the latest developments and tools for building data infrastructure, learn about the real world examples from top....

[+]
Written by Yaniv Leven |May 18, 2017

Data Industry and Trends

Data Jobs in High Demand: 2017 statistics

Across industries, a rapidly rising demand for data scientists and engineers by far outstripps supply. In fact, the shortage of skilled IT professionals is one of the main factors that is slowing....

[+]
Written by Yaniv Leven |May 11, 2017

Data Industry and Trends

What Star Wars Can Teach us about Analytics Infrastructure

Big Data can be a seductive master. How can you maximize time-to-insight without going over to the Dark Side?

[+]
Written by Yaniv Leven |May 04, 2017

Data Industry and Trends

How To Become A Data Engineer: A Guide

The demand for skilled Data Engineers is projected to rapidly grow.  No wonder that’s the case: no matter what your company does, to succeed in today’s competitive environment, you need a robust....

[+]
Written by Yaniv Leven |April 27, 2017

AWS Redshift Data Industry and Trends

Amazon Athena Does Battle: Comparing Athena and Redshift

Data warehouse technologies are advancing towards interactive, real-time, and analytical solutions. In particular, cloud-based data warehouse technologies have reached new heights with the help of....

[+]
Written by Alon Brody |April 18, 2017

Data Industry and Trends

Cloud data warehousing trends 2017

It is an exciting time for cloud data warehousing with significant disruptions expected throughout 2017. As Gartner, in March 2016, showed, warehousing enterprises continue to race against one....

[+]
Written by Yaniv Leven |April 13, 2017

Data Industry and Trends

AI, NLP and Machine Learning: Data Engineering in 2017

For many organizations, their ability to collect data has long surpassed their ability to organize it quickly enough for analysis. As companies of all sizes are increasingly pressured to leverage....

[+]
Written by Yaniv Leven |April 06, 2017

Data Industry and Trends

Apache Spark: Promises and Challenges

If you’re looking for a solution for processing huge chuncks of data, then there are lots of options these days. Depending on your use case and the type of operations you want to perform on data,....

[+]
Written by Alon Brody |December 20, 2016

Data Industry and Trends

Data-Oriented Takeaways from AWS re:Invent 2016: Query S3, Batch, Glue and More

Attendance at this year’s AWS re:Invent conference almost doubled, from 18,000 people last year to 32,000 people last week. The large, international cloud computing event attracted professionals....

[+]
Written by Yaniv Leven |December 05, 2016

Data Industry and Trends

AWS re:Invent 2016 - The Top 5 Amazon Redshift Breakout Sessions

We’re sure you’re already beginning to build your re:Invent schedule for 2016. As the largest cloud conference in the world approaches, it’s time to make sure that you’re maximizing your time and....

[+]
Written by Peter Gorne |November 16, 2016

Data Industry and Trends

Never judge a book by its cover: data infrastructure and data visualization, mutually exclusive or not?

This is the third and final part in the 101 series covering big data concepts, terminology and technology

[+]
Written by Moran Gilad Halevi |May 23, 2016