AI-powered search & chat for Data / Computer Science Students
Learn more with these recommended learning resources
Extract & Load, Transform, Learn, and Serve — Getting Value from Data
Every company wants to deliver high-value data insights, but not every company is ready or able. Too often, they believe the marketing hype around point-and-click, no-code data connectors. Just set…
Read more at Towards Data Science
Find similar
Extracting and Transforming Data in Python
It is important to be able to extract, filter, and transform data from DataFrames in order to drill into the data that really matters. The pandas library has many techniques that make this process…
Read more at Towards Data Science
5 Helpful Extract & Load Practices for High-Quality Raw Data
Immutable raw areas, no transformations, no flattening, and no dedups before finishing your excavations Excavator - photo by Dmitriy Zub on Unsplash. This post is an updated version of the original v...
Read more at Towards Data Science
Extract-Transform-Load in Elasticsearch and Python
Key takeaways of connecting and working with Elasticsearch-Python interfaces for high data volumes on ETL processes. When we’re designing an enterprise-level solution, one specific layer we take…
Read more at Analytics Vidhya
What is ETL (Extract, Transform, Load)?
Let’s understand the importance of ETL. Figure 1: Image by Hands off my tags! Michael Gaida from Pixabay Introduction ETL became popular in the 1970s as companies started storing business data in nume...
Read more at Python in Plain English
Extract, Transform, Load (ETL) — AWS Glue
AWS Glue is a fully managed, server-less ETL service which can be used to prepare and load data for data analytics purposes. The service can be used to catalog data, clean it, enrich it, and move it…
Read more at Towards Data Science
Build The World’s Simplest ETL (Extract, Transform, Load) Pipeline in Ruby With Kiba
You can always roll your own, but a number of packages exist to make writing ETL’s clean, modular and testable. ETL stands for “extract, transform, load”, but unless you come from a data mining…
Read more at Towards Data Science
Data Extraction
The applications of machine learning and deep learning models are emerging every day and a paramount question arises for a beginner: “From where to start?” As a newcomer in Data Science field, mind…
Read more at Towards Data Science
Extract Transform Load (ETL) for Books to Scrape
Web scraping is the process of extracting data from websites. All the job is carried out by a piece of code which is called a “scraper”. First, it sends a “GET” query to a specific website. Then, it…
Read more at Analytics Vidhya
Data Pipeline: From ETL to EL Plus T
New challenges lead to new tools, then new challenges? Photo by Roman Pentin on Unsplash In the data pipeline, we often talk about ETL, aka Extract-Transform-Load, which is actually a very simple pro...
Read more at Better Programming
Four Basic Ways to Automate Data Extraction
People who do data analysis know that how to get data is a crucial step. Data extraction is the basis of data analysis. Without data, analysis is meaningless. Sometimes, how many data sources we…
Read more at Towards Data Science
Datameer — Simple transformations
No code SaaS data transformation tool.
Read more at Towards Data Science
Transformers: How Do They Transform Your Data?
Diving into the Transformers architecture and what makes them unbeatable at language tasks Image by the author In the rapidly evolving landscape of artificial intelligence and machine learning, one i...
Read more at Towards Data Science
How I Wrangle Data At The Command Line
In this article, I will share some tips on doing data wrangling at the command line. The target audience for this article is data scientists who are unfamiliar with the command line beyond…
Read more at Towards AI
Data Transformation
Understand how data transformation helps machine learning pipelines perform better. Gain insight into how to transform non-linear problems into linear ones.
Read more at Towards Data Science
Transforms
Transforms Data does not always come in its final processed form that is required for training machine learning algorithms. We use transforms to perform some manipulation of the data and make it suita...
Read more at PyTorch Tutorials
— Work with ZIP archives
zipfile — Work with ZIP archives Source code: Lib/zipfile.py The ZIP file format is a common archive and compression standard. This module provides tools to create, read, write, append, and list a ZI...
Read more at The Python Standard Library
Transformers for Tabular Data
How to use SageMaker’s built-in algorithm TabTransformer with your own data Image by author (created with OpenAI’s DALL·E 2) What is this about? In June 2022 AWS announced a new range of built-in alg...
Read more at Towards Data Science
#10 Data Engineering — TRANSFORM DATA — Working with Data Types (ETL Pipeline)
This is the tenth blog in the series of posts related to Data Engineering. I have been writing all the important things that I learn as a part of the Data Scientist Nanodegree Program, Udacity. I…
Read more at Python in Plain English
3 Common Techniques for Data Transformation
This article takes you through the journey of transforming data according to the data properties, including log transformation, clipping transformation, data scaling.
Read more at Towards Data Science
Transformations
The first set of operations that we are going to consider works on an array and processes it in the base of a function to produce certain results. There are several possible results: a single value wi...
Read more at Mastering JavaScript Functional Programming
Squeeze Your Data With Python
Python’s powerful solutions for archiving and zipping Files Continue reading on Python in Plain English
Read more at Python in Plain English
3 Simple Steps to Merge a Large Number of Files using Python
After data extraction, we usually need to merge those files together for further analysis. It can be several files, but it can also be hundreds of files. It’s easy to copy and paste the data we need…
Read more at Analytics Vidhya
Data Transfer Process with Python
In this post, we will develop a process for downloading multiple files with URL link, unzip files with “… tsv.gz” extension in a loop and transfer the data to SQL tables. Although you do not always…
Read more at Analytics Vidhya- «
- ‹
- …