HTTP Requests using requests in Python0%

HTTP Requests using requests in Python

Intermediate8 min read•Updated: 2026-10-01

HTTP Requests Using the Requests Library in Python

In modern software development, applications rarely operate in isolation. They communicate with external web services, payment gateways, authentication providers, and cloud databases via HTTP (Hypertext Transfer Protocol). While Python includes a standard urllib module, the third-party requests library is the undisputed industry standard—dubbed "HTTP for Humans"—due to its intuitive, developer-friendly API.

1. The HTTP Request-Response Cycle

HTTP follows a classic client-server model:

1
Client Request: Your Python script sends a message specifying a Method (GET, POST), target URL, optional Headers (metadata), and optional Body payload.
2
Server Response: The remote server processes the request and responds with a Status Code, response headers, and body content (HTML, JSON, XML, or binary data).

Common HTTP Status Codes:

200 OK: Request succeeded.
201 Created: Resource successfully created.
400 Bad Request: Malformed client payload.
401 Unauthorized: Authentication credentials missing or invalid.
403 Forbidden: Authenticated, but lacking permission.
404 Not Found: Target endpoint does not exist.
500 Internal Server Error: Server-side crash.
503 Service Unavailable: Server overloaded or undergoing maintenance.

2. Installing and Making Your First Request

Install the library using pip:

1pip install requests

Making a basic GET request:

1import requests
2 
3url = "https://httpbin.org/get"
4 
5# Send an HTTP GET request
6response = requests.get(url)
7 
8# Inspect the response
9print(f"Status Code: {response.status_code}")  # 200
10print(f"Is Successful? {response.ok}")        # True
11print(f"Content Type: {response.headers.get('Content-Type')}")

3. Key Attributes of the `Response` Object

Attribute / Method	Description	Example
`response.status_code`	Integer HTTP status code	`200`, `404`
`response.ok`	Boolean: `True` if status code < 400	`True`
`response.text`	Decoded string content (uses encoding)	`"{\"title\": \"...\"}"`
`response.content`	Raw binary bytes (for images/files)	`b'\x89PNG...'`
`response.headers`	Case-insensitive dictionary of HTTP headers	`{'Date': '...', ...}`
`response.url`	Final URL after any redirects	`"https://..."`
`response.raise_for_status()`	Raises `HTTPError` if status is 4xx or 5xx	Exception or `None`

1import requests
2 
3res = requests.get("https://httpbin.org/status/404")
4 
5try:
6    # Automatically throws requests.exceptions.HTTPError if request failed
7    res.raise_for_status()
8except requests.exceptions.HTTPError as err:
9    print(f"HTTP Failure intercepted: {err}")

4. Setting Timeouts: A Critical Best Practice

By default, requests does not time out. If an external server freezes or hangs, your Python script will wait indefinitely, blocking execution and consuming server threads.

Always pass the timeout parameter (in seconds):

1import requests
2 
3try:
4    # Wait maximum 3.5 seconds for connection & data
5    response = requests.get("https://httpbin.org/delay/2", timeout=3.5)
6    print("Success:", response.status_code)
7except requests.exceptions.Timeout:
8    print("Request timed out! Server was too slow to respond.")

5. Comprehensive Error Handling with `requests.exceptions`

All exceptions in the requests library inherit from requests.exceptions.RequestException. Handle network errors defensively:

1import requests
2from requests.exceptions import ConnectionError, Timeout, HTTPError, RequestException
3 
4def fetch_data_safely(endpoint_url: str):
  try:
      response = requests.get(endpoint_url, timeout=5)
      response.raise_for_status()  # Check for 4xx/5xx errors
      return response.text
      
  except ConnectionError:
      print(f"[Error] Failed to connect to server. Check DNS or internet connection.")
  except Timeout:
      print(f"[Error] The request timed out.")
  except HTTPError as http_err:
      print(f"[Error] HTTP protocol error occurred: {http_err}")
  except RequestException as err:
      print(f"[Error] Ambiguous request exception: {err}")
      
  return None
20 
21data = fetch_data_safely("https://httpbin.org/get")

⚠️ Common Intermediate Mistakes & Gotchas

1. Forgetting `timeout` on Network Calls

By default, requests.get() will wait indefinitely if a remote server hangs. Always provide an explicit timeout: requests.get(url, timeout=5.0).

2. Skipping `response.raise_for_status()`

A response with HTTP 404 (Not Found) or 500 (Server Error) does not raise an exception automatically. Always call response.raise_for_status() to catch HTTP errors reliably.

💻 Try It Yourself: Safe GitHub User Profile Inspector

Scenario

Use the requests library to query GitHub's public API for a user profile (https://api.github.com/users/<username>), verifying status codes and displaying the public repository count.

Complete Solution

1import requests
2 
3def inspect_github_user(username):
  url = f"https://api.github.com/users/{username}"
  try:
      response = requests.get(url, timeout=5.0)
      response.raise_for_status()
      data = response.json()
      print(f"User: {data.get('name')} (@{data.get('login')})")
      print(f"Public Repos: {data.get('public_repos')}")
      print(f"Followers: {data.get('followers')}")
  except requests.exceptions.HTTPError as err:
      if response.status_code == 404:
          print(f"Error: User '{username}' was not found on GitHub.")
      else:
          print(f"HTTP Error: {err}")
  except requests.exceptions.RequestException as err:
      print(f"Network Connection Failed: {err}")
19 
20# Inspect user
21inspect_github_user("octocat")

Expected Output

1User: The Octocat (@octocat)
2Public Repos: 8
3Followers: 15000+

Interactive Quiz• Knowledge Check

Practice Quiz

Question 1

What does the response.ok property return when a server responds with status code 200?

Question 2

What happens if you make a requests.get() call without specifying a timeout argument and the remote server never responds?

Question 3

Which method raises an HTTPError if the response status indicates an error (4xx or 5xx)?

Question 4

What is the difference between response.text and response.content?

Question 5

What is the common base class for all exceptions raised by the requests library?

🚀 What's Next?

In the next lesson, we will continue your intermediate Python journey with GET & POST Methods (8: Working with APIs).

👉 Continue to Next Lesson: GET & POST Methods →

Next Lesson

GET & POST Methods

Continue learning with hands-on practice, examples, and exercises in the upcoming topic.

Related Lessons

Previous Lesson	Next Lesson
Project: Infinite Sequence Generator	GET & POST Methods

Practice Quiz

Test your understanding of this lesson with 5 questions. Each question has one correct answer.

Previous Next

PreviousPrevNext

MSK Institute • Shikohabad

Loading Page Content...

Preparing courses, live labs, and learning resources.सामग्री लोड हो रही है, कृपया प्रतीक्षा करें...

Connecting serverPlease wait...

💻 Practical Labs🚀 Free Demo📜 Verified Certificates

GET & POST Methods

HTTP Requests using requests in Python

Intermediate8 min read•Updated: 2026-10-01

Study Materials Cheatsheet

HTTP Requests Using the Requests Library in Python

1. The HTTP Request-Response Cycle

HTTP follows a classic client-server model:

1
Client Request: Your Python script sends a message specifying a Method (GET, POST), target URL, optional Headers (metadata), and optional Body payload.
2
Server Response: The remote server processes the request and responds with a Status Code, response headers, and body content (HTML, JSON, XML, or binary data).

Common HTTP Status Codes:

200 OK: Request succeeded.
201 Created: Resource successfully created.
400 Bad Request: Malformed client payload.
401 Unauthorized: Authentication credentials missing or invalid.
403 Forbidden: Authenticated, but lacking permission.
404 Not Found: Target endpoint does not exist.
500 Internal Server Error: Server-side crash.
503 Service Unavailable: Server overloaded or undergoing maintenance.

2. Installing and Making Your First Request

Install the library using pip:

1pip install requests

Making a basic GET request:

1import requests
2 
3url = "https://httpbin.org/get"
4 
5# Send an HTTP GET request
6response = requests.get(url)
7 
8# Inspect the response
9print(f"Status Code: {response.status_code}")  # 200
10print(f"Is Successful? {response.ok}")        # True
11print(f"Content Type: {response.headers.get('Content-Type')}")

3. Key Attributes of the `Response` Object

Attribute / Method	Description	Example
`response.status_code`	Integer HTTP status code	`200`, `404`
`response.ok`	Boolean: `True` if status code < 400	`True`
`response.text`	Decoded string content (uses encoding)	`"{\"title\": \"...\"}"`
`response.content`	Raw binary bytes (for images/files)	`b'\x89PNG...'`
`response.headers`	Case-insensitive dictionary of HTTP headers	`{'Date': '...', ...}`
`response.url`	Final URL after any redirects	`"https://..."`
`response.raise_for_status()`	Raises `HTTPError` if status is 4xx or 5xx	Exception or `None`

1import requests
2 
3res = requests.get("https://httpbin.org/status/404")
4 
5try:
6    # Automatically throws requests.exceptions.HTTPError if request failed
7    res.raise_for_status()
8except requests.exceptions.HTTPError as err:
9    print(f"HTTP Failure intercepted: {err}")

4. Setting Timeouts: A Critical Best Practice

By default, requests does not time out. If an external server freezes or hangs, your Python script will wait indefinitely, blocking execution and consuming server threads.

Always pass the timeout parameter (in seconds):

1import requests
2 
3try:
4    # Wait maximum 3.5 seconds for connection & data
5    response = requests.get("https://httpbin.org/delay/2", timeout=3.5)
6    print("Success:", response.status_code)
7except requests.exceptions.Timeout:
8    print("Request timed out! Server was too slow to respond.")

5. Comprehensive Error Handling with `requests.exceptions`

All exceptions in the requests library inherit from requests.exceptions.RequestException. Handle network errors defensively:

1import requests
2from requests.exceptions import ConnectionError, Timeout, HTTPError, RequestException
3 
4def fetch_data_safely(endpoint_url: str):
  try:
      response = requests.get(endpoint_url, timeout=5)
      response.raise_for_status()  # Check for 4xx/5xx errors
      return response.text
      
  except ConnectionError:
      print(f"[Error] Failed to connect to server. Check DNS or internet connection.")
  except Timeout:
      print(f"[Error] The request timed out.")
  except HTTPError as http_err:
      print(f"[Error] HTTP protocol error occurred: {http_err}")
  except RequestException as err:
      print(f"[Error] Ambiguous request exception: {err}")
      
  return None
20 
21data = fetch_data_safely("https://httpbin.org/get")

⚠️ Common Intermediate Mistakes & Gotchas

1. Forgetting `timeout` on Network Calls

By default, requests.get() will wait indefinitely if a remote server hangs. Always provide an explicit timeout: requests.get(url, timeout=5.0).

2. Skipping `response.raise_for_status()`

A response with HTTP 404 (Not Found) or 500 (Server Error) does not raise an exception automatically. Always call response.raise_for_status() to catch HTTP errors reliably.

💻 Try It Yourself: Safe GitHub User Profile Inspector

Scenario

Use the requests library to query GitHub's public API for a user profile (https://api.github.com/users/<username>), verifying status codes and displaying the public repository count.

Complete Solution

1import requests
2 
3def inspect_github_user(username):
  url = f"https://api.github.com/users/{username}"
  try:
      response = requests.get(url, timeout=5.0)
      response.raise_for_status()
      data = response.json()
      print(f"User: {data.get('name')} (@{data.get('login')})")
      print(f"Public Repos: {data.get('public_repos')}")
      print(f"Followers: {data.get('followers')}")
  except requests.exceptions.HTTPError as err:
      if response.status_code == 404:
          print(f"Error: User '{username}' was not found on GitHub.")
      else:
          print(f"HTTP Error: {err}")
  except requests.exceptions.RequestException as err:
      print(f"Network Connection Failed: {err}")
19 
20# Inspect user
21inspect_github_user("octocat")

Expected Output

1User: The Octocat (@octocat)
2Public Repos: 8
3Followers: 15000+

Interactive Quiz• Knowledge Check

Practice Quiz

Question 1

What does the response.ok property return when a server responds with status code 200?

Question 2

What happens if you make a requests.get() call without specifying a timeout argument and the remote server never responds?

Question 3

Which method raises an HTTPError if the response status indicates an error (4xx or 5xx)?

Question 4

What is the difference between response.text and response.content?

Question 5

What is the common base class for all exceptions raised by the requests library?

🚀 What's Next?

In the next lesson, we will continue your intermediate Python journey with GET & POST Methods (8: Working with APIs).

👉 Continue to Next Lesson: GET & POST Methods →

Next Lesson

GET & POST Methods

Continue learning with hands-on practice, examples, and exercises in the upcoming topic.

Related Lessons

Previous Lesson	Next Lesson
Project: Infinite Sequence Generator	GET & POST Methods

Practice Quiz

Test your understanding of this lesson with 5 questions. Each question has one correct answer.

Previous Next

HTTP Requests Using the Requests Library in Python

1. The HTTP Request-Response Cycle

Common HTTP Status Codes:

2. Installing and Making Your First Request

3. Key Attributes of the Response Object

4. Setting Timeouts: A Critical Best Practice

5. Comprehensive Error Handling with requests.exceptions

⚠️ Common Intermediate Mistakes & Gotchas

1. Forgetting timeout on Network Calls

2. Skipping response.raise_for_status()

💻 Try It Yourself: Safe GitHub User Profile Inspector

Scenario

Complete Solution

Expected Output

Practice Quiz

🚀 What's Next?

GET & POST Methods

Related Lessons

Practice Quiz

Loading Page Content...

HTTP Requests Using the Requests Library in Python

1. The HTTP Request-Response Cycle

Common HTTP Status Codes:

2. Installing and Making Your First Request

3. Key Attributes of the Response Object

4. Setting Timeouts: A Critical Best Practice

5. Comprehensive Error Handling with requests.exceptions

⚠️ Common Intermediate Mistakes & Gotchas

1. Forgetting timeout on Network Calls

2. Skipping response.raise_for_status()

💻 Try It Yourself: Safe GitHub User Profile Inspector

Scenario

Complete Solution

Expected Output

Practice Quiz

🚀 What's Next?

GET & POST Methods

Related Lessons

Practice Quiz

3. Key Attributes of the `Response` Object

5. Comprehensive Error Handling with `requests.exceptions`

1. Forgetting `timeout` on Network Calls

2. Skipping `response.raise_for_status()`

3. Key Attributes of the `Response` Object

5. Comprehensive Error Handling with `requests.exceptions`

1. Forgetting `timeout` on Network Calls

2. Skipping `response.raise_for_status()`