IoT Application Development The Internet of Things is generating many opportunities for Data Engineers to develop useful applications. Think about self driving cars, they are just one large moving IoT devices. When developing IoT applications … [Continue reading]
Snapshots in OneFS 8.0 & Beyond Isilon's OneFS Snapshots allows administrators to protect data at directory and sub-directory level. Snapshots can be taken as one-time snaps or scheduled. The OneFS snapshots also integrate with windows shadow … [Continue reading]
Is GDPR Good or Bad? How many emails have you received about GDPR? At this point I almost have to set a rule in Outlook to send all emails with the word "GDPR" in them to a separate folder. I've explained what GDPR is and how it applies to Data … [Continue reading]
Why Tensorflow is Awesome for Machine Learning Machine Learning and Deep Learning has exploded in both growth and workflows in the past year. When I first started out with Machine Learning the process was still somewhat limited as were the … [Continue reading]
Why Data Engineers Should Care About IoT The Internet of Things has been around for a few years but has hit an all time high for buzzword status. Is IoT important for Data Engineers and Machine Learning Engineers to understand? By 2020 Gartner … [Continue reading]
Early in my career as a Data Engineer I spent a majority of my time in ETL hell. If you aren't familiar with ETL it stands for Extract, Transform, and Load. Basically it's the process Data Engineers use to put structure to unstructured data. In a IoT … [Continue reading]
Freelance Hadoop Admin Roles A lot of the world's economy is shifting to freelance/contracting economy or what Seth Godin terms as a "gig" economy. For Data Engineers heavy on the development side of Hadoop projects that is an easy transition. … [Continue reading]
Shoe Dog Book Review Slowly working my way to completing all the book recommendation I keep finding. Shoe Dog was recommended from many different sources as a must read business book. The story is the journey of Phil Knight building the company that … [Continue reading]
Spark & Hadoop Workloads are Huge Data Engineers and Big Data Developers spend a lot of type developing their skills in both Hadoop and Spark. For years Hadoop's MapReduce was King of the processing portion for Big Data Applications. However for … [Continue reading]
How does GDPR Impact Data Engineers The General Data Protection Regulation (GDPR) goes into effect in May 2018. Many organizations are scrambling to understand how to implement these regulations. In this video we will be discussing Big Data Impact … [Continue reading]
Data Engineers & Big Data Administrators In today's episode of Big Data Big Questions we tackle what the skills are needed for Big Data Administrators. Data Engineers wear many hats in Data Analytic workflows, one part software engineer and one … [Continue reading]
What is a Machine Learning Engineer? Move over Data Scientist the Machine Learning Engineer is now the best role in Big Data Analytics. The Machine Learning Engineer is a hybrid mix of half Data Engineer and half Data Scientist, who can … [Continue reading]