System design question: Amazon SDE2: Large xml files to json conversion
Anonymous User
2266
Design a system,
Input: XML files containing transactions data
Output: JSON file, with each transaction object converted to json object.
Some stats:
- File size - ~ 2GB
- Files/second - around 100 files
- The format of the xml will be simple. Transactions tag, containing all transcation objects.
- Resulting json file can be output few minutes. No need of real-time oputput, or giving output json file in few seconds.
I was stumped on how to parallelise conversion of xml to json for a single file. Any ideas about that?
How would you go about clarifying this question further and how would you approach it.
Comments (6)


