Web Scraping with Python: BeautifulSoup, Requests & Selenium

Web Scraping with Python: BeautifulSoup, Requests & Selenium, available at $59.99, has an average rating of 4.65, with 86 lectures, 4 quizzes, based on 910 reviews, and has 6356 subscribers.

You will learn about Python Refresher: Review of Data Structures, Conditionals, File Handling How Websites are Hosted on Servers; Basic Calls to Server (GET, POST Methods) Web Scraping with Python Beautiful Soup and Requests Using Selenium to handle JavaScript and AJAX Diverse Web Scraping Exercises Source codes (*.py files) for all Exercises can be downloaded Q&A board to send your questions and get them answered quickly This course is ideal for individuals who are Those who want to learn how to use Python for web scraping and data extraction. It is particularly useful for Those who want to learn how to use Python for web scraping and data extraction.

Enroll now: Web Scraping with Python: BeautifulSoup, Requests & Selenium

Summary

Title: Web Scraping with Python: BeautifulSoup, Requests & Selenium

Price: $59.99

Average Rating: 4.65

Number of Lectures: 86

Number of Quizzes: 4

Number of Published Lectures: 72

Number of Published Quizzes: 1

Number of Curriculum Items: 91

Number of Published Curriculum Objects: 74

Original Price: $89.99

Quality Status: approved

Status: Live

What You Will Learn

Python Refresher: Review of Data Structures, Conditionals, File Handling
How Websites are Hosted on Servers; Basic Calls to Server (GET, POST Methods)
Web Scraping with Python Beautiful Soup and Requests
Using Selenium to handle JavaScript and AJAX
Diverse Web Scraping Exercises
Source codes (*.py files) for all Exercises can be downloaded
Q&A board to send your questions and get them answered quickly

Who Should Attend

Those who want to learn how to use Python for web scraping and data extraction.

Target Audiences

Those who want to learn how to use Python for web scraping and data extraction.

Web Scraping (also termed Screen Scraping, Web Data Extraction, Web Harvesting, etc.) is a technique for extracting large amounts of data from websites and save the the extracted data to a local file or to a database.

In this course, you will learn how to perform web scraping using Python 3 and the Beautiful Soup, a free open-source library written in Python for parsing HTML.

We will use lxml, which is an extensive library for parsing XML and HTML documents very quickly; it can even handle messed up tags. We will also be using the Requests module instead of the already built-in urllib2 module due to improvements in speed and readability.

Finally, we will use Selenium alongside Beautiful Soup to crawl AJAX & JavaScript driven pages.

The course cover the following topics: accessing web pages programmatically; scraping web pages to extract the required data using Beautiful Soup to parse web pages; interacting with web pages to do different things with them programmatically; and using Selenium for web scraping and when we need it.

By the end of this course, you will be able to understand how websites and servers function, diverse data extraction techniques, and methods of handling and organizing data.

This Web Scraping course covers the following topics:

Review of data structures (Lists, Dictionaries, Tuples, File Handling)
How websites are hosted on servers
Calls to the server (GET, POST methods)
Review of HTML and CSS
Requests Module and BeautifulSoup Module overview
Parsing HTML using BeautifulSoup
Filtering elements using BeautifulSoup and navigating the Parse Tree
JavaScript and AJAX overview
Selenium and the need for it
Selecting elements using Selenium�
CSS selectors�
XPath selectors�
Navigating pages using Selenium�
Practical Projects

Course Curriculum

Chapter 1: Web Scraping Course Overview

Lecture 1: Web Scraping Course Overview

Chapter 2: Python Refresher: Data Structures (Optional)

Lecture 1: Lists

Lecture 2: Dictionaries

Lecture 3: Tuples

Lecture 4: List Comprehensions – Part 1

Lecture 5: List Comprehensions – Part 2

Lecture 6: Inline – if else and List Comprehensions

Lecture 7: Installing xlrd and XlsxWriter to Read/Write to Excel Files

Lecture 8: Wrting to Excel Files

Lecture 9: Reading from Excel Files

Lecture 10: Python Editor & Other Software

Lecture 11: Exercise #1: YOU: Web Scraping Expert

Chapter 3: How Servers Work

Lecture 1: How Websites are Hosted

Lecture 2: HTML Revision

Chapter 4: BeautifulSoup Warm-up Exercise

Lecture 1: BeautifulSoup Solved Exercise

Chapter 5: Installing Required Python Packages

Lecture 1: Installing Required Python Packages

Chapter 6: Introduction to Requests Python Library

Lecture 1: Requests Get Method

Lecture 2: User Agent

Lecture 3: Installing fake_useragent Package

Chapter 7: Introduction to Beautiful Soup Python Library

Lecture 1: Web Scraping with Beautiful Soup – Overview

Lecture 2: Web Scraping with Beautiful Soup – Overview P.2

Lecture 3: Accessing Tags

Lecture 4: Navigable Strings

Chapter 8: Navigating with Beautiful Soup – Going Down

Lecture 1: Navigating through Tag Names

Lecture 2: Contents and Children Methods

Lecture 3: Descendants Method

Chapter 9: Navigating with Beautiful Soup – Going Up

Lecture 1: Parent Method

Lecture 2: Parents Method

Chapter 10: Navigating with Beautiful Soup – Going Sideways

Lecture 1: next_sibling

Lecture 2: previous_sibling

Lecture 3: next_siblings & previous_siblings

Chapter 11: Regular Expressions with Python

Lecture 1: Metacharacters Overview

Lecture 2: Compile Function and Character Class

Lecture 3: Special Sequences

Lecture 4: * Repeating Things

Lecture 5: + Repeating Things

Lecture 6: ? and {m,n} Repeating Things

Lecture 7: Metacharacters part2

Chapter 12: Searching the Parse Tree Using Beautiful Soup

Lecture 1: Introduction to Searching with BeautifulSoup

Lecture 2: find_all Function

Lecture 3: find_all More Parameters

Lecture 4: find Function

Chapter 13: Project 1: Scraping CustomerReports Website

Lecture 1: Web Scraping CustomerReports – part 1

Lecture 2: Web Scraping CustomerReports – part 2

Chapter 14: Project 2: Web Scraping CodingBat Website with Beautiful Soup

Lecture 1: Project 2 Description

Lecture 2: Web Scraping CodingBat – part 1

Lecture 3: Web Scraping CodingBat – part 2

Lecture 4: Web Scraping CodingBat – part 3

Chapter 15: Using Selenium to Handle AJAX & JavaScript Driven Web Pages

Lecture 1: JavaScript, AJAX and Selenium intro

Lecture 2: Installing Selenium

Lecture 3: Installing ChromeDriver

Lecture 4: Introduction to Selenium

Lecture 5: Searching Elements and Inputting Data

Lecture 6: Clicking Elements

Lecture 7: XPath Introduction

Lecture 8: XPath Examples

Chapter 16: Project 3: Web Scraping Your Instagram Account

Lecture 1: Project 3 Description

Lecture 2: Logging in to Instagram

Lecture 3: Settings Tab!

Lecture 4: Opening Target Profile (NEW)

Lecture 5: Scrolling Down v.1 (NEW)

Lecture 6: Scrolling Down v.2 (NEW)

Lecture 7: Exception Handling (NEW)

Lecture 8: Making Folders (NEW)

Lecture 9: Downloading Images v.1 (NEW)

Lecture 10: Downloading Images v.2 (NEW)

Lecture 11: Downloading Captions (NEW)

Lecture 12: Writing Captions to Excel File (NEW)

Lecture 13: Instagram Final Code – Updated: 2018-06-22

Chapter 17: Web Scraping Best Practices

Lecture 1: Web Scraping Best Practices

Chapter 18: Bonus: Data Extraction with APIs

Lecture 1: Data Extraction with APIs (Free Tutorial)

Chapter 19: Bonus: Scrapy: Powerful Web Scraping and Crawling Framework in Python

Lecture 1: Coupon for "Scrapy: Powerful Web Scraping & Crawling with Python" Course

Instructors

GoTrained Academy
eLearning Professionals
Waqar Ahmed

Rating Distribution

1 stars: 30 votes
2 stars: 39 votes
3 stars: 159 votes
4 stars: 303 votes
5 stars: 379 votes

Frequently Asked Questions

How long do I have access to the course materials?

You can view and review the lecture materials indefinitely, like an on-demand channel.

Can I take my courses with me wherever I go?

Definitely! If you have an internet connection, courses on Udemy are available on any device at any time. If you don’t have an internet connection, some instructors also let their students download course lectures. That’s up to the instructor though, so make sure you get on their good side!

Menu