Training courses, hackathons, events and jobs for Machine Learning & AI Engineers

A Comprehensive Guide to File Formats in Data Engineering

Python in Plain English

Understanding the Pros and Cons of using CSV, JSON, Parquet, Avro, and ORC file format in Data Engineering. Photo by Mika Baumeister on Unsplash Introduction In big data and data engineering, choosing...

File Formats

The Python Standard Library

File Formats The modules described in this chapter parse various miscellaneous file formats that aren’t markup languages and are not related to e-mail. csv — CSV File Reading and Writing Module Conte...

Extra Data Types

FastAPI Documentation

Extra Data Types Up to now, you have been using common data types, like: int float str bool But you can also use more complex data types. And you will still have the same features as seen up to now: ...

Data Types

The Python Standard Library

Data Types The modules described in this chapter provide a variety of specialized data types such as dates and times, fixed-type arrays, heap queues, double-ended queues, and enumerations. Python als...

Long and Wide Formats in Data, Explained

Towards Data Science

How to deal with them Pandas-style Continue reading on Towards Data Science

Data Loading, Storage, and File Formats

Python for Data Analysis Book

Reading data and making it accessible (often called data loading ) is a necessary first step for using most of the tools in this book. The term parsing is also sometimes used to describe loading text ...

Data Loading, Storage, and File Formats

Python for Data Analysis Book

Reading data and making it accessible (often called data loading ) is a necessary first step for using most of the tools in this book. The term parsing is also sometimes used to describe loading text ...

Comparing Performance of Big Data File Formats: A Practical Guide

Towards Data Science

Parquet vs ORC vs Avro vs Delta Lake Photo by Viktor Talashuk on Unsplash The big data world is full of various storage systems, heavily influenced by different file formats. These are key in nearly ...

Find Datasets: Soul of a Data Scientist

Python in Plain English

A dataset is simply a collection of data. The simplest and most common format for datasets you’ll find online is a spreadsheet or CSV format (a single file organized as a table of rows and columns)…

COCO data format for Object detection

Towards Data Science

In this article, we will understand two popular data formats: COCO data format and Pascal VOC data formats. These data formats are used for annotating objects found in a data set used for computer…

The Language of Maps: A Guide to Geospatial Data Formats and Coordinates

Towards Data Science

Whenever I use tools like Google Maps or Uber, I sometimes find myself overlooking the complexity of the challenge they aim to solve. These apps need to make highly advanced calculations all while sho...