Categories
data engineering sessions

DILG – ISTMS Training on Pentaho Data Integration

Through BusinessMinds, I had the privilege of teaching students from DILG. “I am responsible for my data.” Take care of it! More power to DILG!

DILG Information Systems and Technology Management Services organized a training on data integration and analysis using Pentaho for its data governance initiatives. Through BusinessMinds, I had the privilege of teaching students from different functions ranging from planning to monitoring. The training was an intensive 3 day course full of hands-on exercises to turn messy data into gold.

IMG_20180322_084658

Day 1 consisted of data integration concepts, real world use cases, Pentaho solution stack overview and some basic integration exercises. Students particularly enjoyed the web services integration. Connecting websites have never been so easy. Day 2 was a more in-depth exploration of the features available in Pentaho like analytics, join operations, preprocessing and excel manipulation. The students performed some complex tasks that are analogues of daily operational activities and reporting. Day 3 involved database exploration. Ultimately, all data looks largely the same in Pentaho, regardless of the data source. We also did a section on automating operational work. Capping it all of is a checklist on some data integration best practices that I hope shall be realized very soon.

IMG_20180323_125253

The mood was light and casual. Exercises are structured to have a little hand-holding but some are meant to be experiment-driven. “Errors are okay!” A little sand from the sandbox won’t hurt.

“I am responsible for my data.” Take care of it!

More power to DILG!

 

 

 

By krsnewwave

I'm a software engineer and a data science guy on recommender systems, natural language processing, and computer vision.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s