Data Engineer Intern
Kpler, Belgium

Experience
1 Year
Salary
0 - 0
Job Type
Job Shift
Job Category
Traveling
No
Career Level
Telecommute
No
Qualification
As mentioned in job details
Total Vacancies
1 Job
Posted on
Sep 2, 2021
Last Date
Oct 2, 2021
Location(s)

Job Description

In a world where trades are happening faster than ever to answer our needs, where sustainability is not just an option anymore, clarity and trust in the information we trade with are a must.
So, say hello to Kpler! We exist to facilitate sustainable and efficient trade to meet the changing needs of our world. To do so we've built a Data-as-a-Service solution that does exactly that across the lifecycle of a trade.
Our solution aggregates data from hundreds of sources including radar and satellite imagery as well as logistics, governmental, shipping databases and more. Intelligently connecting the dots across fragmented information landscapes, we bring to our clients a unique, real-time understanding of the trades happening all over the world, by giving them access to live information about the movement of cargos, the availability of vessels as well as the commodity storage.
To support this endeavor we have teams in more than 7 countries and 7 key locations (Paris, London, Brussels, Dubai, Singapore, Houston and New York). With individuals of various backgrounds, diverse skills, and international experiences, being global amp; inclusive is in our DNA!
Our values
•Be humble - Our self-interest does not compromise the collective interest•Respect and care for others - We treat everyone as an individual•Take responsibility - We take ownership of our actions•Act with integrity - We do the right thing, always•Be bold - We challenge ourselves and the status quo with action
You’ll get to work in a truly global environment, with more than 20 nationalities speaking more than 15 languages.

Description:
The role is to join the Data Sourcing Crew, which is the team in charge of ETL (Extract- Transform - Load) systems with the goal to automate the frequent extraction of data from various sources and format (HTML, json API, PDF, Excel, etc), then normalize the data and store it on AWS S3 and other datastore like ElasticSearch.The intern will be managed by the Engineering Manager in charge of the Data Sourcing Crew, and will primarily work with Senior Data Engineers based in Singapore, and occasionally with other teams based in Europe or US.The intern should have an interest to learn data engineering, python coding language, sql and databases.
Key Responsibilities:
1. Working with the Project Manager, create python code to extract automatically complex data from various formats (web, API, pdf, excel)2. Develop tests to ensure that the scraping code perform as expected3. Participate in coding the dashboard and tooling to monitor the code execution4. Brainstorm with more senior Data Engineers on how to improve the architecture and processes
Competencies to learn:1. Learn how to professionally code in python and SQL2. Discover cloud deployment and tooling on AWS3. Learn how to extract data from websites (scraping) and ETL4. Learn how to develop using lean and agile principles5. Obtain knowledge on how to use cutting edge tools to manage code development, monitoring and devops (github, CI, Datadog)6. Participate in the evolution of the technical architecture
Duration of Internship / Attachment Offered: 6 monthsOur People Pledge
Kpler is committed to providing a fair, inclusive and diverse work-environment. We believe that different perspectives lead to better ideas, and better ideas allow us to better understand the needs and interests of our diverse, global community. We welcome people of different backgrounds, experiences, abilities and perspectives and are an equal opportunity employer.

Job Specification

Job Rewards and Benefits

Kpler

Information Technology and Services - San Jose, United States
© Copyright 2004-2024 Mustakbil.com All Right Reserved.