He wants to invest in a scalable system and he is thinking to recruit a software engineer and a data engineer (you).
The software engineer has to come up with a mobile app that allows the sales agents to report their sales from the app.
The app should be connected with a data pipeline that would eventually make the data ready for analysis.
– What would be your strategy to build a strong and reliable data pipeline and how will you structure it ? Explain the different steps for processing the data, what makes each step important?
Mention which tools would you use for each of these steps. Feel free to argument as much as you feel it relevant You’re free to make assumptions about the mobile app e.g. The raw data is stored in a No-Sql database…