AWS Data Wrangler

3 minute read | Last updated 2-Aug-2022 | An icon depicting a retail tag with a heart for 'favourite' AWS Cloud

AWS Labs has a lot of open source code up on GitHub. In this post, we’re taking a look at AWS Data Wrangler. This project provides a smoother interface between python pandas DataFrames and various AWS Cloud data services.

I call out a few more details in the Twitter thread below…

Tweet 1/8 Next tweet

AWS Data Wrangler, https://github.com/awslabs/aws-data-wrangler, is an interesting project from the @awscloud ProServe team

it aims to connect python pandas data frames to various AWS services

☁️ #cloud #devops

marknca @marknca tweeted at 19-Nov-2021, 13:02

Tweet 2/8 Next tweet Start

this thread (unrolled) is up at https://t.co/v1ZIBgC6W3

the last thread is up at https://markn.ca/2021/amazon-api-gateway-serverless-developer-portal/

☁️ #cloud #devops

marknca @marknca tweeted at 19-Nov-2021, 13:02

Tweet 3/8 Next tweet Start

if you’ve been anywhere near a data science project, you’ve probably seen either the scipy, numpy, or pandas projects in python…or all three

they are awesome

one of the fundamental units of these projects is the DataFrame, https://pandas.pydata.org/pandas-docs/stable/user_guide/dsintro.html

☁️ #cloud #devops

marknca @marknca tweeted at 19-Nov-2021, 13:02

Tweet 4/8 Next tweet Start

the AWS Data Wrangler project lets you save DataFrames to various @awscloud data services

this could save a ton of time for your python projects

☁️ #cloud #devops

marknca @marknca tweeted at 19-Nov-2021, 13:02

Tweet 5/8 Next tweet Start

the repo has a broad spectrum of samples, all in @ProjectJupyter notebooks. I ❤️ that because it makes it easier to play with the code

find the tutorials at https://github.com/awslabs/aws-data-wrangler/tree/main/tutorials

☁️ #cloud #devops

marknca @marknca tweeted at 19-Nov-2021, 13:02

Tweet 6/8 Next tweet Start

this project installs via standard pip but is also available as a Lambda layer, in the AWS Glue shell, in @awscloud SageMaker Notebooks, and more

that flexibility is much appreciated

☁️ #cloud #devops

marknca @marknca tweeted at 19-Nov-2021, 13:02

Tweet 7/8 Next tweet Start

this library does more than just save and load data, the full API for it is up at https://aws-data-wrangler.readthedocs.io/en/2.12.1/api.html

there’s a lot of very useful data manipulation functions here

☁️ #cloud #devops

marknca @marknca tweeted at 19-Nov-2021, 13:02

Tweet 8/8 Next tweet Start

all-in-all if you’re using pandas, scipy, or numpy in your python project and your data is on @awscloud, you’ll want to—at the very least—check out the AWS Data Wrangler at https://github.com/awslabs/aws-data-wrangler

/ ☁️ #cloud #devops

marknca @marknca tweeted at 19-Nov-2021, 13:02

Start