+61480015851
Data Engineering Technical - Data Validation and Data Flow - Engineering Assessment Answer
Download Solution
Order New Solution
Internal Code: 1AGBIB
Data Engineering Technical Assessment Answer
Assignment Task: About this assignment The objective of this assignment is to help us better understand your technical skills and the way you approach a problem. It’s not designed to have a single right answer -- we’re more interested in understanding your thought process. We’re also looking for the standards and best practices you use in the code you write, and the design decisions you make, so don’t be shy about submitting commentary and reflections on the assignment. Context At Arup we work a lot with transport data, so we’re interested in data-centric services that tell us something about mobility in general, the transport network itself, and/or how it performs. Assignment brief- Take a look at this dataset about road traffic accidents in 2016 (zip file, described here).
- The data contains location information in Eastings/Northings and Longitude/Latitude. Write some code in a language of your choice to validate this location data. Choose whatever validation methods/approaches you feel are appropriate.
- Pick one of the following scenarios:
- Managing the arrival of this data in (close to) real time and storing it for later analysis. b. Distributing this data to a range of consumers, as it arrives.
- Describe (in words, a sketch, or both) how you would architect a pipeline or service to achieve the task/scenario you chose in point 3 above.
- Submit your assignment as below to chris.norvall@arup.com
This Data Engineering Technical Assessment has been solved by our Engineering experts at onlineassignmentbank. Our Assignment Writing Experts are efficient to provide a fresh solution to this question. We are serving more than 10000+ Students in Australia, UK & US by helping them to score HD in their academics. Our Experts are well trained to follow all marking rubrics & referencing style.