Artemio Rimando - Evaluating a life measured in smiles | A data scientist lifestyle blog
  • HOME
  • LET’S COLLABORATE
    • CONTACT ME
    • SUBSCRIBE
    • BIG BROTHER GAMES
      • INQUIRY
      • PAST GAMES
  • ABOUT
    • CREDENTIALS
    • ABOUT
  • DATA SCIENCE
    • PYTHON
    • APPLIED LEARNING
    • SOFT SKILLS
  • CAREER
    • CAREER ADVICE
    • RECRUITMENT ADVICE
  • LIFESTYLE
    • OUT AND PROUD
    • LIFESTYLE
  • TRAVEL
    • HONG KONG
    • MACAU
    • SAN FRANCISCO
HOME
LET'S COLLABORATE
    CONTACT ME
    SUBSCRIBE
    BIG BROTHER GAMES
    INQUIRY
    PAST GAMES
ABOUT
    CREDENTIALS
    ABOUT
DATA SCIENCE
    PYTHON
    APPLIED LEARNING
    SOFT SKILLS
CAREER
    CAREER ADVICE
    RECRUITMENT ADVICE
LIFESTYLE
    OUT AND PROUD
    LIFESTYLE
TRAVEL
    HONG KONG
    MACAU
    SAN FRANCISCO
Artemio Rimando - Evaluating a life measured in smiles | A data scientist lifestyle blog
  • HOME
  • LET’S COLLABORATE
    • CONTACT ME
    • SUBSCRIBE
    • BIG BROTHER GAMES
      • INQUIRY
      • PAST GAMES
  • ABOUT
    • CREDENTIALS
    • ABOUT
  • DATA SCIENCE
    • PYTHON
    • APPLIED LEARNING
    • SOFT SKILLS
  • CAREER
    • CAREER ADVICE
    • RECRUITMENT ADVICE
  • LIFESTYLE
    • OUT AND PROUD
    • LIFESTYLE
  • TRAVEL
    • HONG KONG
    • MACAU
    • SAN FRANCISCO
Amazon S3•Applied Learning•Data Engineering•Data Science•Python•Slack•Snowflake

Data Engineering using Airflow with Amazon S3, Snowflake and Slack

In any organization that depends on continuous batches of data for the purposes of decision-making analytics, it becomes super important to streamline and automate data processing workflows. Larger teams will usually consist of a Data Architect who carefully creates the blueprints of the data infrastructure, a Data Engineer who dives into the code to build out the data infrastructure, a Data Analyst who gathers and assesses the data needs across different functional teams and ensures the reliability of the data, and a Data Scientist who uses the data to create business value through machine learning. For a data science team to work cohesively together, I think it is super important that every person on the team has some knowledge of another data member’s role and functions. I also think this is the best way to really elevate yourself as a team player and become a well-rounded data professional.

In this blog post, I aim to demonstrate how a Data Scientist can expand their data engineering knowledge and skills through creating simple data pipelines using Apache Airflow. In addition to Airflow, this post includes Amazon S3, Snowflake and Slack as part of the technology stack to demonstrate how fruitful a Data Scientist’s toolkit can be. I hope to present how awesome and powerful these tools can be to better your data products and data science projects.

Continue reading

Meet Artemio!

Artemio is a Torontonian-at-heart living in Vancouver, BC. You can find him in and around the city sipping bubble tea and playing Pokemon GO.

Welcome!

You will find blog posts written about a passion for data science, travel, and the joys of life.

Follow Me!

Subscribe Here!

Instagram Feed

artemiorimando

Achoo-choo 🇨🇦🚂 #covidtravel2020 #wearamas Achoo-choo 🇨🇦🚂 #covidtravel2020 #wearamask #choochootrain #revelstoke #beautifulbc🍁
Stay golden 🌄 #covidtravel2020 #albertaviews #l Stay golden 🌄 #covidtravel2020 #albertaviews #lakeannette
Out here capturing a summer take of a similar phot Out here capturing a summer take of a similar photo I took in the winter last year 🙈🤓 #covidtravel2020 #albertaviews #lakelouisecanada
Crystal clear 😌 #covidtravel2020 #albertaviews Crystal clear 😌 #covidtravel2020 #albertaviews #morainelake #luckyaf
Looking like sound waves but all I hear is quiet 😌🌄 #covidtravel2020 #albertaviews #pyramidlake #tranquil
Early riser 🌄🇨🇦 #covidtravel2020 #jasperp Early riser 🌄🇨🇦 #covidtravel2020 #jasperprovincialpark #albertaviews
Feeling lucky we saw the highest point of the Cana Feeling lucky we saw the highest point of the Canadian Rockies today 🇨🇦🏞️🚡 #covidtravel2020 #albertaviews #luckyaf
Streaming Game 6 and walking this trail 😏🦖🇨🇦 #winwin #covidtravel2020 #beautifulbc🍁 #kamloops
As of late, caused unnecessary game drama/stress w As of late, caused unnecessary game drama/stress with friends and family 😏, (ironically) advocated for destigmatizing mental health 🙏, longest streak for not leaving the house was like 20 days, drank a lot of bubble tea, and a picture under a bridge to show for it. 2020 has been wild so far. #pandemic #staysafe
Smoggy sunrise 🇹🇭 #thailand #bangkok #infini Smoggy sunrise 🇹🇭 #thailand #bangkok #infinitypool #sunrise #gaytravel #gaypassport #travelasia #instatravel #travelpics #travelgram #travel #globetrotter #igtravel #igtravelworld
Wet trunks, sandy toes, sun block, speedy boats 🇹🇭 #thailand #phuket #kohphiphi #phiphi #phiphiislands #paradise #gaytravel #gaypassport #travelasia #instatravel #travelpics #travelgram #travel #globetrotter #igtravel #igtravelworld
Ayy Okay👌🕶️🇹🇭 #thailand #phuket #koh Ayy Okay👌🕶️🇹🇭 #thailand #phuket #kohphiphi #phiphi #phiphiislands #gaytravel #gaypassport #travelasia #instatravel #travelpics #travelgram #travel #globetrotter #igtravel #igtravelworld
🤳 Big Buddha 🇹🇭 #thailand #phuket #bigbud 🤳 Big Buddha 🇹🇭 #thailand #phuket #bigbuddha #gaytravel #gaypassport #travelasia #instatravel #travelpics #travelgram #travel #globetrotter #igtravel #igtravelworld #blackandwhite
🇻🇳 Long 🐲 Lan 🦁 Quy 🐢 Phung🐥 #v 🇻🇳 Long 🐲 Lan 🦁 Quy 🐢 Phung🐥

#vietnam #haolu #ancientcapital #ancient #gaysian #gaytravel #gaypassport #instagay #travelasia #instatravel #travelpics #travelgram #travel #globetrotter #igtravel #igtravelworld #blackandwhite
Ha Long Bae 🚣‍♂️🇻🇳 #vietnam #halong Ha Long Bae 🚣‍♂️🇻🇳 #vietnam #halongbay #baitulongbay #gaysian #gaytravel #gaypassport #instagay #travelasia #instatravel #travelpics #travelgram #travel #globetrotter #igtravel #igtravelworld #blackandwhite
Load More... Follow on Instagram

Most Popular Posts

  • Data Engineering using Airflow with Amazon S3, Snowflake and Slack
    Data Engineering using Airflow with Amazon S3, Snowflake and Slack
  • Extract, Transform, and Load Yelp Data using Python and Microsoft SQL Server
    Extract, Transform, and Load Yelp Data using Python and Microsoft SQL Server

Links to the Past

artemiorimando

Achoo-choo 🇨🇦🚂 #covidtravel2020 #wearamas Achoo-choo 🇨🇦🚂 #covidtravel2020 #wearamask #choochootrain #revelstoke #beautifulbc🍁
Stay golden 🌄 #covidtravel2020 #albertaviews #l Stay golden 🌄 #covidtravel2020 #albertaviews #lakeannette
Out here capturing a summer take of a similar phot Out here capturing a summer take of a similar photo I took in the winter last year 🙈🤓 #covidtravel2020 #albertaviews #lakelouisecanada
Crystal clear 😌 #covidtravel2020 #albertaviews Crystal clear 😌 #covidtravel2020 #albertaviews #morainelake #luckyaf
Looking like sound waves but all I hear is quiet 😌🌄 #covidtravel2020 #albertaviews #pyramidlake #tranquil
Early riser 🌄🇨🇦 #covidtravel2020 #jasperp Early riser 🌄🇨🇦 #covidtravel2020 #jasperprovincialpark #albertaviews
Follow on Instagram
This error message is only visible to WordPress admins
Error: There is no connected account for the user 31859063.

Subscribe for new updates!

© 2019 ARTEMIO RIMANDO // All rights reserved.