NumPy and pandas Essentials

Outline

Chapter 1 - Essential NumPy

• Doing the Hands-on Exercises
• NumPy
• The Python and C Connection
• NumPy Characteristics
• NumPy Efficiencies
• The ndarray Object vs Python Sequence
• The ndarray Data Structure Visually
• The First Take on NumPy Arrays and the array() Method
• Getting Help
• The np.info() Function
• The arange() Method
• Hands-on Exercises
• Re-Shaping, Take 1
• Re-Shaping with Order
• "Smart" Reshaping
• Hands-on Exercises
• Array Slicing
• Array Slicing Visually
• 2-D Array Slicing
• Slicing and Stepping Through
• Getting Last Row and Last Column
• Indexing with Arrays of Indices
• Hands-on Exercises
• Understanding NumPy Types
• Commonly Used Platform-Portable ndarray Numeric Data Types
• Other Data Types
• Unicode Strings
• Example of a Boolean Array
• Changing the Data Type using astype()
• Hands-on Exercises
• Commonly Used Array Metrics
• Example of Getting Common Array Metrics
• What is An ndarray Axis?
• Commonly Used Aggregate (Reduction) Functions
• Axis-Aware Aggregate Functions Visually
• The NaN Value
• The nan_to_num() Function
• NaN in Aggregate Functions
• The NaN-Tolerant Functions
• The inf Value
• The inf-Related Functions
• Checking for Valid Numbers in an ndarray
• Hands-on Exercises
• The newaxis Attribute
• Flattening the Matrices
• The ravel() Method
• Changing Order When Flattening with ravel()
• ravel(): Things to be Aware of ...
• The flatten() Method
• Flattening with reshape(-1)
• Flattening Using the [:,-1] Operator
• Hands-on Exercises
• Understaning Little-Endian and Big-Endian Byte Encodings
• Handling Little-Endian and Big-Endian Byte Encodings in NumPy
• Creating "Dummy" Arrays
• "Dummy" Arrays Visually
• The "Dummy-Like" Arrays
• Hands-on Exercises
• The view() Function
• The copy() Function
• The Issue of Shallow Copies of Python Lists
• The True "Deep Copy"
• Hands-on Exercises
• Vectorization
• Vectorization Visually
• Broadcasting
• Broadcasting Visually
• Hands-on Exercises
• Array Arithmetic Operations
• Filtering
• Hands-on Exercises
• The any() and all() Functions
• Combining Arrays
• Examples of Combining Arrays
• The append() Function
• Hands-on Exercises
• The insert() Function
• The delete() Function
• Hands-on Exercises
• I/O Operations
• Examples of I/O Operations
• I/O Operations Considerations
• Using unique() and repeat()
• Sundry Functions
• Support for Generating Random Numbers
• Seeding
• The NumPy Random Generator's Methods
• Generating Random Numbers
• Descriptive Statistics
• Hands-on Exercises
• Sorting Arrays
• Sorting Examples
• Understanding argsort()
• The argmin() and argmax() Functions
• Hands-on Exercises
• Summary

Chapter 2 - Essential pandas

• Doing the Hands-on Exercises
• What is pandas?
• The Main Features and Capabilities
• The Core High-Level Data Structures
• The Series Object
• Understanding the View and Copy Aspects of the Input Data
• Example of a Series Object
• Accessing Values and Indexes in the Series Object
• The Index Property
• Using the Series Index as a Lookup Key
• Useful Series Methods
• The Series Object Supports NumPy Array Operations
• Can I Pack a Python Dictionary into a Series?
• Hands-on Exercises
• The DataFrame Object
• The DataFrame's Value Proposition
• Creating a DataFrame
• Example of Creating a pandas DataFrame from a NumPy Array
• Creating a pandas DataFrame from a Python Dictionary
• Plugging In Your Own Index
• Example of Using Your Own Index
• Getting DataFrame Metrics
• Creating a Column with Auto-Incremented Values
• The DataFrame info() Method
• The describe() Method
• Example of a describe() Output when called on a DataFrame
• Example of a describe() Output when called on a Series
• Accessing DataFrame Columns
• Accessing DataFrame Rows
• Renaming DataFrame Columns
• Hands-on Exercises
• Accessing DataFrame Cells
• The iloc[] Property
• Examples of Using the iloc() DataFrame Method
• Using a Function in iloc
• The Type of Object iloc Returns
• The loc[] Property
• Examples of Using loc[]
• Hands-on Exercises
• Filtering in DataFrames
• Examples of DataFrame Filtering
• Using any() and all() with loc[]
• The filter() Method
• DataFrames are Mutable via Object Reference!
• Iterating over DataFrame's Contents
• Example of Iterating over DataFrame's Contents
• Hands-on Exercises
• The Axes
• Deleting Rows and Columns
• More on the drop() DataFrame Method
• Examples of Using the drop() Method
• Adding a New Column to a DataFrame
• Appending/Concatenating DataFrame and Series Objects
• The concat() Method
• Using the concat() Method
• Reindexing
• Re-indexing Series and DataFrames
• Joining DataFrames
• Understanding the get_dummies() DataFrame Method
• Example of Using the get_dummies() Method
• Hands-on Exercises
• What are Descriptive Statistics?
• Calculating Descriptive Statistics and Summary Measures in pandas
• Calculations Along axes
• Examples of Axis-Specific DataFrame Operations
• The nlargest() and nsmallest() Methods
• Hands-on Exercises
• Sorting DataFrame Values
• Hands-on Exercises
• The pandas I/O: Reading Methods
• Reading From CSV Files
• The pandas I/O: Writing Methods
• Writing to a CSV File
• Writing to the System Clipboard
• Hands-on Exercises
• The apply() Function
• Example of Using the apply() Function
• Minimizing DataFrames' Memory Footprint

Lab Exercises

• Lab 1. Learning the Colab Jupyter Notebook Environment
• Lab 2. Essential NumPy
• Lab 3. Essential pandas