3.2.2 Meme Generator — Text on Images

Overview

NumPy is excellent at moving pixels around, but it has no concept of type. Drawing a glyph means turning a TrueType outline into a rasterised silhouette and then alpha-blending that silhouette onto the canvas — a small ecosystem of font hinting, kerning, and anti-aliasing that you do not want to re-implement. Pillow’s ImageDraw.text wraps all of that in three lines [1]. This short lesson is the bridge between the pixel arrays you have been editing and a richer rendering surface, and the round-trip — np.array(image) and Image.fromarray(array) — is the same trick every later “annotate this output” workflow needs.

Learning objectives

1. Open an image with Pillow and create an ImageDraw.Draw surface bound to its pixel buffer.
2. Load a TrueType font with ImageFont.truetype and call draw.text to lay glyphs onto the canvas.
3. Convert between Pillow Image and NumPy ndarray with np.array(...) and Image.fromarray(...).
4. Layer a translucent banner under a caption so it is legible over any background.

Quick start — two lines of caption

from PIL import Image, ImageDraw, ImageFont

img = Image.open('bridge.png')
draw = ImageDraw.Draw(img)
font = ImageFont.truetype('arial.ttf', 30)

draw.text((20, 390), 'All your dreams are on their way',
          fill='white', font=font)
draw.text((20, 430), '(Simon & Garfunkel)',
          fill='white', font=font)

img.save('bridge_meme.png')

Core concepts

Concept 1 — Pillow’s drawing surface

Pillow’s Image object owns a pixel buffer; the ImageDraw.Draw wrapper exposes drawing methods that mutate that buffer. The constructor binds, not copies — so the same Image is what you eventually save:

img  = Image.open('bridge.png')
draw = ImageDraw.Draw(img)        # binds to img.load() — no copy

The draw object has methods for every primitive you might want: text, line, rectangle, polygon, ellipse, arc. The text call is the only one we need this lesson, but the rest are useful any time NumPy would force you to re-derive low-level rasterisation [2].

Concept 2 — TrueType fonts

Glyphs are not pixels; they are mathematical outlines. ImageFont.truetype loads a .ttf file at a given pixel size and prepares an internal rasteriser. You pass the resulting font object to every draw.text call:

font = ImageFont.truetype('arial.ttf', 30)   # 30 px height
draw.text((20, 390), 'caption', fill='white', font=font)

'arial.ttf' resolves from Pillow’s font search path; on Windows that path includes C:\Windows\Fonts, where Arial lives by default. If the font is not found, Pillow raises OSError; you can pass an absolute path instead. For lessons you should ship a small open-licensed font alongside the script — the DejaVu family is bundled with most Pillow installations and works cross-platform.

Concept 3 — Round-tripping with NumPy

The most important integration trick is the two-line round trip between Pillow and NumPy:

arr = np.array(img)              # Pillow → NumPy. Shape (H, W, 3) for RGB, uint8.
img = Image.fromarray(arr)       # NumPy → Pillow. Inferred mode from dtype + shape.

The pixel buffer is shared on the read; copied on the write. So a common workflow is:

1. Open the image with Pillow.
2. Convert to NumPy for vectorised pixel work (masks, channel swaps, distortions).
3. Convert back to Pillow for text or shape drawing.
4. Save.

Skipping the NumPy step is fine for “just add a caption” lessons like this one. Skipping the Pillow step is fine when you have no text or shape work to do. Most real pipelines hop back and forth as needed.

Exercises

Three exercises in Execute → Modify → Create order: run the quick start, vary the captioning, then build a translucent banner.

draw.text((20, 20), 'All your dreams are on their way', fill='white', font=font)
draw.text((20, 60), '(Simon & Garfunkel)',              fill='white', font=font)

font = ImageFont.truetype('arial.ttf', 48)
draw.text((20, 380),
          'All your dreams are on their way — Simon & Garfunkel',
          fill='white', font=font)

draw.text((20, 390), 'All your dreams are on their way',
          fill=(255, 200, 80), font=font)

from PIL import Image, ImageDraw, ImageFont

# Open as RGBA so the overlay can be transparent
base = Image.open('bridge.png').convert('RGBA')
overlay = Image.new('RGBA', base.size, (0, 0, 0, 0))   # fully transparent

draw = ImageDraw.Draw(overlay)
font = ImageFont.truetype('arial.ttf', 30)

# TODO 1: draw a half-transparent black rectangle behind the caption area.
#         draw.rectangle((x0, y0, x1, y1), fill=(0, 0, 0, alpha))

# TODO 2: draw the two-line caption *on the overlay*, in solid white.

# TODO 3: alpha-composite the overlay onto the base, then save.
result = Image.alpha_composite(base, overlay).convert('RGB')
result.save('caption_with_banner.png')

banner = (0, 370, base.size[0], 480)
draw.rectangle(banner, fill=(0, 0, 0, 160))   # alpha ~63% opaque

draw.text((20, 385), 'All your dreams are on their way', fill='white', font=font)
draw.text((20, 425), '(Simon & Garfunkel)',              fill='white', font=font)

from PIL import Image, ImageDraw, ImageFont

base = Image.open('bridge.png').convert('RGBA')
overlay = Image.new('RGBA', base.size, (0, 0, 0, 0))
draw = ImageDraw.Draw(overlay)
font = ImageFont.truetype('arial.ttf', 30)

# Translucent banner behind the caption
banner = (0, 370, base.size[0], 480)
draw.rectangle(banner, fill=(0, 0, 0, 160))

# Caption on top, solid white
draw.text((20, 385), 'All your dreams are on their way', fill='white', font=font)
draw.text((20, 425), '(Simon & Garfunkel)',              fill='white', font=font)

result = Image.alpha_composite(base, overlay).convert('RGB')
result.save('caption_with_banner.png')

Downloads

Summary

Common pitfalls to avoid

• Pillow’s (x, y) vs NumPy’s (row, col) = (y, x) — easy to get wrong when switching back and forth.
• Calling draw.text before truetype is set — Pillow falls back to its bitmap default font (small and crude).
• Passing an RGBA tuple to an RGB image’s draw call — the alpha is silently dropped, which is rarely what you wanted.
• Saving as JPEG when the workflow uses RGBA — JPEG does not support transparency; PNG does.
• Forgetting that ImageDraw.Draw(img) binds to img. If you discard the Draw object, img already has your edits.

References