TOOLS AND TECHNOLOGIES

Outside of Programming, Probability, Statistics, Data Modeling, Machine Learning, Data Visualization, Evaluation, and the following are the set of the pre-requisite :

  • Participants are responsible for bringing a Workstation/Laptop with SDK/Tools Installed.
  • Languages: - Python or R
  • Tools: Visual Studio Code/Juypter Notebook/R Studio

The following AWS resources will be available during the hackathon. Relevant tutorials and documentation are provided for participants to get familiarized with these technologies.

QuickSight (BI Dashboards/reports/analytics tool)

Description:  Unified business intelligence tool to meet varying analytics needs such as modern interactive dashboards, paginated reports, embedded analytics, and natural language queries.

Documentation: https://aws.amazon.com/quicksight/ 

Youtube video: https://www.youtube.com/watch?v=2KEWxdPiUh8 

Workshop: https://catalog.workshops.aws/quicksight/en-US 

 

Sagemaker Canvas (for AI/ML)

Description:  A visual point-and-click interface to generate accurate ML predictions for classification, regression, forecasting, natural language processing (NLP), and computer vision (CV).

Documentation: https://docs.aws.amazon.com/sagemaker/latest/dg/canvas.html 

Youtube video: https://www.youtube.com/watch?v=8gm1TD9TXp0 

Workshop:   https://catalog.us-east-1.prod.workshops.aws/workshops/80ba0ea5-7cf9-4b8c-9d3f-1cd988b6c071/en-US 

 

Glue Data Brew (for Data Transformation/Cleansing)

Description:  AWS Glue DataBrew is a visual data preparation tool that makes it easier for data analysts and data scientists to clean and normalize data to prepare it for analytics and machine learning (ML). 

Documentation: https://aws.amazon.com/glue/features/databrew/ 

Youtube video: https://www.youtube.com/watch?v=G8o5ekfbBO4 

Workshop:  https://catalog.us-east-1.prod.workshops.aws/workshops/6532bf37-3ad2-4844-bd26-d775a31ce1fa/en-US 

 

S3 (for Data Storage)

Description:  Object storage built to retrieve any amount of data from anywhere

Documentation: https://aws.amazon.com/s3/ 

Youtube video: https://www.youtube.com/watch?v=e6w9LwZJFIA     or   https://www.youtube.com/watch?v=FZCZbPEMlXk 

 

IAM (Security policies and permissions)

Description:  AWS Identity and Access Management (IAM) securely manages identities and access to AWS services and resources

Documentation:   https://aws.amazon.com/iam/ 

Workshop:   https://catalog.workshops.aws/general-immersionday/en-US/basic-modules/30-iam/iam#identity-and-access-management-(iam)-overview 

 

Athena (can be used for SQL queries on S3 data)

Description:  Analyze data where it lives with ease and flexibility, for example, the data that resides in S3. 

Documentation: https://aws.amazon.com/athena/ 

Blog: https://aws.amazon.com/blogs/big-data/accessing-and-visualizing-data-from-multiple-data-sources-with-amazon-athena-and-amazon-quicksight/ 

Workshop:  https://catalog.us-east-1.prod.workshops.aws/workshops/9981f1a1-abdc-49b5-8387-cb01d238bb78/en-US