Understanding Iterators in Python0%

Understanding Iterators in Python

Intermediate8 min read•Updated: 2026-10-01

Understanding Iterators in Python

Iteration is one of the most fundamental operations in Python. Whenever you write for item in sequence:, Python leverages the Iterator Protocol behind the scenes. Understanding how iterables and iterators function under the hood allows you to process massive datasets memory-efficiently and master advanced Python data patterns.

1. Iterable vs. Iterator: The Core Distinction

Many developers conflate iterables and iterators, but they are distinct concepts in Python:

Iterable: An object that can return an iterator. Any collection that defines an __iter__() method (or implements sequence indexing via __getitem__()) is an iterable. Examples: list, tuple, str, dict, set.
Iterator: A stateful object representing a stream of data. It yields consecutive items one at a time when __next__() is called and maintains its current position in the sequence.

1# A list is an ITERABLE, not an iterator
2fruits = ["Apple", "Mango", "Banana"]
3 
4# We obtain an ITERATOR from the iterable using iter()
5fruit_iterator = iter(fruits)
6print(type(fruit_iterator))  # <class 'list_iterator'>
7 
8# Extract elements one by one using next()
9print(next(fruit_iterator))  # Apple
10print(next(fruit_iterator))  # Mango
11print(next(fruit_iterator))  # Banana
12 
13# Calling next() again raises StopIteration
14try:
15    print(next(fruit_iterator))
16except StopIteration:
17    print("Iterator exhausted!")

2. The Iterator Protocol

The Python Iterator Protocol consists of two methods:

1
__iter__(): Must return the iterator object itself (return self).
2
__next__(): Returns the next item in the stream. When no elements remain, it must raise the StopIteration exception.

Visual Architecture Blueprint

+-------------------+      iter(iterable)      +-------------------+
|     Iterable      | -----------------------> |     Iterator      |
| (list, dict, str) |                          | (stateful stream) |
+-------------------+                          +-------------------+
                                                         |
                                                  next(iterator)
                                                         |
                                                         v
                                              Yields value OR raises
                                                  StopIteration

3. How the `for` Loop Actually Works Under the Hood

When you execute a standard for loop in Python:

1for item in [10, 20, 30]:
2    print(item)

Python actually translates it into this precise while loop logic:

1# Equivalent lower-level execution of a for-loop:
2collection = [10, 20, 30]
3iterator = iter(collection)  # 1. Obtain the iterator
4 
5while True:
6    try:
7        item = next(iterator)  # 2. Fetch the next value
8    except StopIteration:      # 3. Intercept end-of-stream cleanly
9        break
10    else:
11        print(item)            # 4. Execute the loop body

4. Supplying a Default Value to `next()`

The built-in next() function accepts an optional second argument: a default fallback value. If the iterator is exhausted, next() returns this default value instead of raising StopIteration:

1stream = iter([1, 2])
2 
3print(next(stream, "DONE"))  # 1
4print(next(stream, "DONE"))  # 2
5print(next(stream, "DONE"))  # DONE (No exception raised!)
6print(next(stream, "DONE"))  # DONE

This pattern is widely used in search algorithms and queue consumption to retrieve the first matching element safely.

5. Iterators are One-Way and Exhaustible

Unlike lists which can be indexed repeatedly, iterators are stateful, forward-only, and single-use. Once consumed, they cannot be rewound or reset:

1numbers = [1, 2, 3]
2num_iter = iter(numbers)
3 
4# Consume iterator
5sum1 = sum(num_iter)  # 6
6sum2 = sum(num_iter)  # 0! The iterator is already exhausted!
7print(f"First sum: {sum1}, Second sum: {sum2}")

To iterate over the elements again, you must generate a fresh iterator by calling iter(numbers) anew.

⚠️ Common Intermediate Mistakes & Gotchas

1. Confusing Iterables with Iterators

Iterable: An object with an __iter__() method returning a fresh iterator (e.g., list, dict, range). Can be iterated over multiple times.
Iterator: A stateful object with a __next__() method. Once exhausted, it cannot be reset!

2. Expecting `len()` on an Iterator

Iterators calculate items on the fly and do not know their total size in advance. Calling len(iter) raises a TypeError.

💻 Try It Yourself: Custom Reverse Iterator

Scenario

Build a ReverseIterator class that accepts a list and yields elements from last to first using the Iterator Protocol (__iter__ and __next__).

Complete Solution

1class ReverseIterator:
2    def __init__(self, data):
3        self.data = data
4        self.index = len(data) - 1
5 
6    def __iter__(self):
7        return self
8 
9    def __next__(self):
10        if self.index < 0:
11            raise StopIteration
12        item = self.data[self.index]
13        self.index -= 1
14        return item
15 
16numbers = [10, 20, 30, 40]
17rev = ReverseIterator(numbers)
18for num in rev:
19    print(num, end=" ")
20print()

Expected Output

140 30 20 10 

Interactive Quiz• Knowledge Check

Practice Quiz

Question 1

Which special method must an object implement to be classified as an iterable in Python?

Question 2

Which exception signals that an iterator has reached the end of its elements?

Question 3

What is the second argument in next(my_iter, "Empty") used for?

Question 4

What happens when you pass an already consumed iterator to another for loop?

Question 5

Why do iterators provide substantial memory benefits compared to large lists?

🚀 What's Next?

In the next lesson, we will continue your intermediate Python journey with Custom Iterators (7: Iterators and Generators).

👉 Continue to Next Lesson: Custom Iterators →

Next Lesson

Custom Iterators

Continue learning with hands-on practice, examples, and exercises in the upcoming topic.

Related Lessons

Previous Lesson	Next Lesson
Project: Error-Handled Calculator	Custom Iterators

Practice Quiz

Test your understanding of this lesson with 5 questions. Each question has one correct answer.

Previous Next

PreviousPrevNext

MSK Institute • Shikohabad

Loading Page Content...

Preparing courses, live labs, and learning resources.सामग्री लोड हो रही है, कृपया प्रतीक्षा करें...

Connecting serverPlease wait...

💻 Practical Labs🚀 Free Demo📜 Verified Certificates

Custom Iterators

Understanding Iterators in Python

Intermediate8 min read•Updated: 2026-10-01

Study Materials Cheatsheet

Understanding Iterators in Python

1. Iterable vs. Iterator: The Core Distinction

Many developers conflate iterables and iterators, but they are distinct concepts in Python:

Iterable: An object that can return an iterator. Any collection that defines an __iter__() method (or implements sequence indexing via __getitem__()) is an iterable. Examples: list, tuple, str, dict, set.
Iterator: A stateful object representing a stream of data. It yields consecutive items one at a time when __next__() is called and maintains its current position in the sequence.

1# A list is an ITERABLE, not an iterator
2fruits = ["Apple", "Mango", "Banana"]
3 
4# We obtain an ITERATOR from the iterable using iter()
5fruit_iterator = iter(fruits)
6print(type(fruit_iterator))  # <class 'list_iterator'>
7 
8# Extract elements one by one using next()
9print(next(fruit_iterator))  # Apple
10print(next(fruit_iterator))  # Mango
11print(next(fruit_iterator))  # Banana
12 
13# Calling next() again raises StopIteration
14try:
15    print(next(fruit_iterator))
16except StopIteration:
17    print("Iterator exhausted!")

2. The Iterator Protocol

The Python Iterator Protocol consists of two methods:

1
__iter__(): Must return the iterator object itself (return self).
2
__next__(): Returns the next item in the stream. When no elements remain, it must raise the StopIteration exception.

Visual Architecture Blueprint

+-------------------+      iter(iterable)      +-------------------+
|     Iterable      | -----------------------> |     Iterator      |
| (list, dict, str) |                          | (stateful stream) |
+-------------------+                          +-------------------+
                                                         |
                                                  next(iterator)
                                                         |
                                                         v
                                              Yields value OR raises
                                                  StopIteration

3. How the `for` Loop Actually Works Under the Hood

When you execute a standard for loop in Python:

1for item in [10, 20, 30]:
2    print(item)

Python actually translates it into this precise while loop logic:

1# Equivalent lower-level execution of a for-loop:
2collection = [10, 20, 30]
3iterator = iter(collection)  # 1. Obtain the iterator
4 
5while True:
6    try:
7        item = next(iterator)  # 2. Fetch the next value
8    except StopIteration:      # 3. Intercept end-of-stream cleanly
9        break
10    else:
11        print(item)            # 4. Execute the loop body

4. Supplying a Default Value to `next()`

The built-in next() function accepts an optional second argument: a default fallback value. If the iterator is exhausted, next() returns this default value instead of raising StopIteration:

1stream = iter([1, 2])
2 
3print(next(stream, "DONE"))  # 1
4print(next(stream, "DONE"))  # 2
5print(next(stream, "DONE"))  # DONE (No exception raised!)
6print(next(stream, "DONE"))  # DONE

This pattern is widely used in search algorithms and queue consumption to retrieve the first matching element safely.

5. Iterators are One-Way and Exhaustible

Unlike lists which can be indexed repeatedly, iterators are stateful, forward-only, and single-use. Once consumed, they cannot be rewound or reset:

1numbers = [1, 2, 3]
2num_iter = iter(numbers)
3 
4# Consume iterator
5sum1 = sum(num_iter)  # 6
6sum2 = sum(num_iter)  # 0! The iterator is already exhausted!
7print(f"First sum: {sum1}, Second sum: {sum2}")

To iterate over the elements again, you must generate a fresh iterator by calling iter(numbers) anew.

⚠️ Common Intermediate Mistakes & Gotchas

1. Confusing Iterables with Iterators

Iterable: An object with an __iter__() method returning a fresh iterator (e.g., list, dict, range). Can be iterated over multiple times.
Iterator: A stateful object with a __next__() method. Once exhausted, it cannot be reset!

2. Expecting `len()` on an Iterator

Iterators calculate items on the fly and do not know their total size in advance. Calling len(iter) raises a TypeError.

💻 Try It Yourself: Custom Reverse Iterator

Scenario

Build a ReverseIterator class that accepts a list and yields elements from last to first using the Iterator Protocol (__iter__ and __next__).

Complete Solution

1class ReverseIterator:
2    def __init__(self, data):
3        self.data = data
4        self.index = len(data) - 1
5 
6    def __iter__(self):
7        return self
8 
9    def __next__(self):
10        if self.index < 0:
11            raise StopIteration
12        item = self.data[self.index]
13        self.index -= 1
14        return item
15 
16numbers = [10, 20, 30, 40]
17rev = ReverseIterator(numbers)
18for num in rev:
19    print(num, end=" ")
20print()

Expected Output

140 30 20 10 

Interactive Quiz• Knowledge Check

Practice Quiz

Question 1

Which special method must an object implement to be classified as an iterable in Python?

Question 2

Which exception signals that an iterator has reached the end of its elements?

Question 3

What is the second argument in next(my_iter, "Empty") used for?

Question 4

What happens when you pass an already consumed iterator to another for loop?

Question 5

Why do iterators provide substantial memory benefits compared to large lists?

🚀 What's Next?

In the next lesson, we will continue your intermediate Python journey with Custom Iterators (7: Iterators and Generators).

👉 Continue to Next Lesson: Custom Iterators →

Next Lesson

Custom Iterators

Continue learning with hands-on practice, examples, and exercises in the upcoming topic.

Related Lessons

Previous Lesson	Next Lesson
Project: Error-Handled Calculator	Custom Iterators

Practice Quiz

Test your understanding of this lesson with 5 questions. Each question has one correct answer.

Previous Next

Understanding Iterators in Python

1. Iterable vs. Iterator: The Core Distinction

2. The Iterator Protocol

3. How the for Loop Actually Works Under the Hood

4. Supplying a Default Value to next()

5. Iterators are One-Way and Exhaustible

⚠️ Common Intermediate Mistakes & Gotchas

1. Confusing Iterables with Iterators

2. Expecting len() on an Iterator

💻 Try It Yourself: Custom Reverse Iterator

Scenario

Complete Solution

Expected Output

Practice Quiz

🚀 What's Next?

Custom Iterators

Related Lessons

Practice Quiz

Loading Page Content...

Understanding Iterators in Python

1. Iterable vs. Iterator: The Core Distinction

2. The Iterator Protocol

3. How the for Loop Actually Works Under the Hood

4. Supplying a Default Value to next()

5. Iterators are One-Way and Exhaustible

⚠️ Common Intermediate Mistakes & Gotchas

1. Confusing Iterables with Iterators

2. Expecting len() on an Iterator

💻 Try It Yourself: Custom Reverse Iterator

Scenario

Complete Solution

Expected Output

Practice Quiz

🚀 What's Next?

Custom Iterators

Related Lessons

Practice Quiz

3. How the `for` Loop Actually Works Under the Hood

4. Supplying a Default Value to `next()`

2. Expecting `len()` on an Iterator

3. How the `for` Loop Actually Works Under the Hood

4. Supplying a Default Value to `next()`

2. Expecting `len()` on an Iterator