Data Representation and Serialization

Name: Data Representation and Serialization
Rating: 4.9 (7 reviews)

What does that data look like?

Created byITPro TV, Justin Dennison

Last updated 1/2019

English

What you'll learn

Understand and use CSV as a means to store data.
Use Python to read and write CSV data.
Understand and use JSON as a means to store data.
Use Python to read and write JSON data.
Understand and use YAML as a means to store data.
Use Python to read and write YAML data.
Understand and use XML/HTML to store and represent data.
Use Python to read, write, and manipulate XML/HTML data.

Course content

5 sections • 25 lectures • 11h 0m total length

Overview2:29
In this series, we take a look at common formats for saving, reading, and shuffling data around such as Comma Separated Values (CSV), JavaScript Object Notation (JSON), YAML Ain't Markup Language (YAML), and eXtensible Markup Language (XML). If you want to know more about these data formats as well as how to interact with these different data representation using Python, then we will see you there!

What is CSV?21:43
In this episode, Justin and Aubri discuss what a constitutes a csv file.
Explore CSV Files31:05
In this episode, Justin and Aubri expand on CSV files by creating some CSV files manually to represent some common situations. Moreover, Justin demonstrates the difference between typing CSV files versus using tools like spreadsheet software to create those data files.
Use csv Module27:52
In this episode, Justin and Aubri take a look at the standard library csv module to read and write CSV files. Justin expands on the differences between using a standard reader or writer from the module versus using the dictreader or dictwriter from the csv module.
Use csv Module Pt. 226:51
In this episode, Justin and Aubri take a look at the standard library csv module to read and write CSV files utilizing the DictReader and DictWriter objects. Justin expands on some nicer uses when reading and writing CSV files that need to be cleaned up.
Use the pandas Package30:55
In this episode, Justin and Aubri install and use the pandas community package for reading and writing CSV files. Additionally, Justin demonstrates how pandas provide easier interfaces for reading, writing, and cleaning of data.
Use the tablib Package33:16
In this episode, Justin and Aubri utilize the tablib package to create and convert data into the CSV format. Justin expands that tablib provides more control than just the csv module for converting between data representations for the same data, as well as adding data to a CSV collection.

What is JSON?31:12
In this episode, Justin and Aubri discuss what the JSON data format is as well as when it is used. Justin takes a look at information that may be delivered in a JSON format as well as how that is related to the structure of the data.
Explore JSON Files27:45
In this episode, Justin and Aubri construct a JSON file in order to explore the thought processes behind the arrangement of the data. Justin also emphasizes formatting requirements for the JSON data type.
JSON: Use the json Module27:28
In this episode, Justin and Aubri explore how to use the Standard Library json module to read and write json.
JSON: Use the pandas Package30:40
In this episode, Justin and Aubri revisit the pandas package as a means of reading and writing JSON. Justin further demonstrates how the outputs can differ based on aspects of the pandas structures that are being used to create the JSON.
Use the simplejson and ujson Packages23:50
In this episode, Justin and Aubri explore the simplejson and ujson packages for reading and writing JSON. Justin discusses the similarities among the ujson package, simplejson package, and the standard library json module as well as discusses the reasons for picking a tool like ujson or simplejson.
JSON: Use the tablib Package29:43
In this episode, Justin and Aubri revisit the tablib package with JSON instead of CSV data.

What is YAML?21:45
In this episode, Justin and Aubri explore the use of YAML as a way to represent data. Justin dives further into the relationship between JSON and YAML as well as what can be represented.
Explore YAML Files32:35
In this episode, Justin and Aubri construct a YAML file as a means of understanding how the format is utilized and created from scratch.
Use the PyYAML Package34:10
In this episode, Justin and Aubri utilize the PyYAML package to read and write YAML. Justin highlights some security considerations when using PyYAML as well.
YAML: Use the tablib Package13:21
In this episode, Justin and Aubri explore changing CSV and JSON to YAML files using the tablib package.

What is XML?23:13
In this episode, Justin and Aubri discuss what XML or eXtensible Markup Language and how it is utilized.
Explore XML Files32:02
In this episode, Justin and Aubri create an XML document from scratch to explore the thought process for organizing and representing data.
What is HTML?22:44
In this episode, Justin and Wes discuss the relationship between HTML and XML for representing data. Moreover, Justin takes a look at sample HTML pages to see how varied those pages can be.
Explore HTML Files31:44
In this episode, Justin and Wes build an HTML document for a simple website to demonstrate the difference between the representation of a visual arrangement versus the non-visual part of XML.
Use the xml Module24:22
In this episode, Justin and Wes explore the use of the xml module from the Python standard library for reading and writing XML data. Moreover, Justin speaks to security issues and how to alleviate those issues that can arise from using the xml module.
Use the lxml Package29:49
In this episode, Justin and Aubri explore the external package lxml that allows for the reading of XML, but adds some additional functionality. Moreover, Justin discusses why one would choose lxml versus the xml module from the Python standard library.
Use the xmltodict Package25:05
In this episode, Justin and Aubri explore a simplified interface for reading XML data into a Python dictionary.
Use the BeautifulSoup Package25:18
In this episode, Justin and Aubri utilize the BeautifulSoup package to read HTML data and query the document for elements of interest.

Requirements

Familiarity with Python programming.

Description

Data Representation and Serialization

In this series, we take a look at common formats for saving, reading, and shuffling data around such as Comma Separated Values (CSV), JavaScript Object Notation (JSON), YAML Ain't Markup Language (YAML), and eXtensible Markup Language (XML). If you want to know more about these data formats as well as how to interact with these different data representation using Python, then we will see you there!

Course Format

• Binge-worthy TV shows! Watch comprehensive, in-depth episodes that use a talk show-like format to keep you engaged while learning.

• You can pick and choose episodes or you can watch as a complete series.

• A little humor, anecdotes, and real-world examples.

Other Courses

Ready to become a DevPro? Get more DevProTV training with a variety of topics. Join Justin and DevProTV to level up your programming prowess!

Updates and Versions

The programming world updates at a break neck pace. As a result, there are times that certain tools, editors, libraries have changed. While syntax or names may change, the foundations remain the same. Though we hope to keep things updated, there may be time before that can occur. I recommend seeing if you can translate between changes and if all fails, ask questions!

Who this course is for:

Beginner Python developers looking to understand different data storage formats.

Data Representation and Serialization

What you'll learn

Explore related topics

Course content

Overview1 lecture • 2min

CSV6 lectures • 2hr 52min

JSON6 lectures • 2hr 51min

YAML4 lectures • 1hr 42min

XML and HTML8 lectures • 3hr 34min

Requirements

Description

Who this course is for: