Build a Web Scraper in Go Also available in:
Also available in:
Build a web scraper from scratch in Go. It's an SEO analytics tool that reports on the internal linking profile of any website.
Author
Lane Wagner
Lane is a back-end engineer and the lead instructor of Boot.dev. He has taught over one million students worldwide, on Boot.dev, FreeCodeCamp, YouTube and the Backend Banter podcast. Lane worked as a backend engineer writing Go, Python and TypeScript, then moved into engineering management and a couple of years later left to build Boot.dev full-time.
Allan
Maintainer
Matt
Maintainer
Dan
Maintainer
Hunter
Maintainer
What will you learn?
Use Golang to build a web crawler that scrapes pages. It's a tool that any SEO expert would be happy to have. You'll make HTTP requests and parse HTML to generate reports that can easily marshaled to standard output or a file. If you're interested in getting a job doing data analysis, this project will teach you how Go can be used to build a command-line application.
Chapter List
Join 1,062 students in the Build a Web Scraper in Go course
Read reviews of their learning experiences
As an advanced beginner, I found the project to be excellent and challenging. Covers testing, recurs...
tim walker
Seattle, WA
This is one of the nice projects on applying goroutines
Stephen Kisengese
Kenya
A really cool project!
BHUVNESH BHUWAN
Hyderabad, India
Good course
Oleksandr Macedonsky
Kyiv, Ukraine
Amazing course for both web crawler knowledge as well as pushing your understanding of concurrency!
Harold Hernandez
San Jose Del Monte City, Philippines
good course for understanding basic usage of goroutine with web crawling
yanmo
Seoul, Korea
Great course to bolster your skillset with go and have a better skillset for implementing concurrenc...
Bereket Mulugeta Amha
Addis Ababa, Ethiopia
The great guide helped me a lot
Daniel Sogbey
Accra, Ghana
Very fun to play around with goroutines!
Prime Enjoyer xx
Taipei, Taiwan
Showing 1-9 of 11
Mediocrity doesn't cut it anymore
The only way to become a great developer is to write a lot of code
Avoid tutorial hell
by writing a ton of code
Stay motivated with
a game-like curriculum
Build portfolio projects
to prove your skills
Delve deeper
into foundational concepts
Learn flexibly online
without interrupting your life
For 1% the price of college
to minimize your financial risk
Frequently asked Questions
Got questions? We've got answers
Yes! It's free to create an account and start learning. You'll get all the immersive and interactive features for free for a few chapters. After that, if you still haven't paid for a membership, you'll be in read-only (content only) mode.