I am asked the below question in an assessment:
Input -> A real time input stream of data from multiple sources
Black Box -> Real time processing of the data, Scalable Storage of processed data, Building APIs for analytics team to fetch the processed data, Deploying pipelines (written in Python, R, Matlab), built by Data Analytics team
Output -> Broadcast the processed Data to multiple platforms, Web Portal, Mobile Apps, On Premise Analytics Platform (Tableau, Power BI)
Task is to design an architecture for the black box mentioned in the process flow.
I have come up with a flow chart as attached.
Could you please help validate it and let me know if I am missing anything here.