70% Reduction in Report Generation Using Data Lake

Aokumo helped a FinTech client achieve a 70% reduction in report generation time for regulatory reporting and a 99.96% improvement in SLA.

Project Brief

The Client

Based in Tokyo, the client is a Fintech company with a primary business of providing trading services. Tens of thousands of users trade different primary & derived assets on their platform daily.

The Problem

The client was facing issues with their daily reporting being slow, prone to errors, and lacking regulatory requirements.

The Result

Aokumo designed and implemented a data & analytics infrastructure on the AWS cloud to solve their challenges.

Industry

Financial Services

Featured Services

Technology Stack

Amazon S3, AWS Aurora, AWS Lake Formation, AWS Lambda

70% Reduction in Report Generation Using Data Lake

Aokumo helped a FinTech client achieve a 70% reduction in report generation time for regulatory reporting and a 99.96% improvement in SLA.

Industry

Financial Services

Featured Services

Technology Stack

AWS Workspace, Office 365, Azure Active Directory, MicrosoftIntune, AWS VPN

Project Brief

The Client

Based in Tokyo, the client is a Fintech company with a primary business of providing trading services. Tens of thousands of users trade different primary & derived assets on their platform daily.

The Problem

The client was facing issues with their daily reporting being slow, prone to errors, and lacking regulatory requirements.

The Solution

Aokumo designed and implemented a data & analytics infrastructure on the AWS cloud to solve their challenges.
results

Solutions

Implemented AWS Data Lake for daily reporting, SLA requirements, and regulatory compliances.

Built the foundation of data cataloging, search, and visualization.

Implemented ETL to collect and validate the data from different resources in near-real-time.

Integrated different AWS services to automate, standardize, and templatize deployment pipelines.

Impacts

4

X

faster deployment time

70

%

time-saving for regulatory filings

5

X

better data quality

99.96~

%

improved SLA

summary

The Need

The client provides trading services through multiple trading systems with their own data structure and way of doing transactions. The client generates daily regulatory reports for compliance and filing purpose. However, due to the inefficiencies in the existing reporting system, they were lagging to meet deadlines.

The client wanted to build a data pipeline and reporting system to satisfy the regulatory requirements with minimum development efforts and time. The client also wanted to ensure that data collected from different sources gets converted to the correct format and accessed securely. However, they were short on time and didn’t have the required skill set in their team.

Aokumo designed and implemented the modern Data Lake, enabling and empowering developers to quickly build jobs for automatic reports generation.

The Challenges

Since the data comes from different systems and in different formats, it was essential to standardize it and store it in a coherent way.

The client had no experience in Data Lakes, so we needed to ensure that they had proper training after implementation.

Reporting was required to be accurate, time-sensitive, and secure to meet regulatory requirements and SLA.

Data security challenges need to be addressed in order to protect confidentiality.

The Solutions

The team at Aokumo used AWS Lake Formation for ease of data infrastructure deployment.

Aokumo implemented a centralized repository of data to enable efficient cataloging, search, and access.

We integrated suitable tools for data validation, incident alerting, and disaster recovery.

We also implemented other cloud-native AWS services to ensure the integrity and authenticity of data.

Tools & Technologies

Aokumo leverages several Amazon services

AWS Lake Formation

- Allows users to easily provision their AWS resources by automating the creation and termination of infrastructure, services, and applications.

Amazon S3

- A highly scalable, fast, and durable solution for any data type object-level storage accessed anywhere via the Internet through the Amazon Console and S3 API.

AWS Glue

- A managed cloud service that makes it easy for customers to prepare data for analysis through automated extract, transform, and load (ETL) processes.

AWS Lambda

- A compute service that lets you run code without provisioning or managing servers.

Amazon Athena

- A serverless interactive analytics service offered by Amazon that can be readily used to gain insights on data residing in S3.

Amazon Aurora

- A managed database service that combines the performance and availability of traditional enterprise databases with the simplicity and cost-effectiveness of open source databases.

Amazon QuickSight

- A cloud-based business intelligence platform that allows users to build visualizations and dashboards and perform ad-hoc analysis.

impact

The Impacts

4

X

faster deployment time

The client is now able to ship new data & analytics capabilities 4 times faster than before.

70

%

time-saving for regulatory filings

Improved data capturing, sanitization, and reporting are saving more than 70% of the client’s time while filing regulatory reports.

5

X

better data quality

Data validation tools and proactive alerts have achieved higher data quality and more accurate insights.

99.96~

%

improved SLA

Cloud-native data & analytics infrastructure has dramatically improved the client’s SLA adherence with high performance, availability, and security.