This demonstration uses sample data. The software program will not fetch all the log files, but a sample of them. The different log files are from AWS-cloudTrail and AWS-config. Logs vary in structure and data. Generally, no two log files are the same.
Fetch gzip json details from s3 bucket
Fetch gzip json details from s3 bucket, unzip
Rearrange JSON clumps as JSONs