Overview

✍️ My Role

Product designer, product owner

👥 Key Stakeholders

UX designers

📅 Year

2026

Peanut Pioneers Program

launched June 2024

🔗 Prototype Links

Peanut Pioneers Program

launched June 2024

The Problem

Long‑form audio is great for learning, but terrible for retention and review.

Using the “Hooked” audiobook as an example, there are 3 common challenges:

1

1

Attention drop

Sessions often last 2+ hours, making it hard to stay focused end to end.

2

2

Hard to revisit

Audio doesn’t support quick scanning, highlighting, or jumping back to specific ideas.

3

3

Fragmented quotes

Pulling out and organizing quotes in a structured way is slow and manual.

“Hooked” audiobook on Spotify

“Hooked” audiobook on Spotify

The Goal

Turn Long Audio into Insights

Turn Long Audio into Insights

Turn hours of audio into a one‑page summary of key ideas, quotes, and lessons.

Turn hours of audio into a one‑page summary of key ideas, quotes, and lessons.

Reduce Cognitive Load

Reduce Cognitive Load

Automatically structure complex conversations into clear takeaways.

Automatically structure complex conversations into clear takeaways.

Share Knowledge

Share Knowledge

Surface the valuable ideas with a shared quote board for collective knowledge sharing.

Surface the valuable ideas with a shared quote board for collective knowledge sharing.

Why LLMs?

I chose LLMs because they can interpret and reorganize long, unstructured, conversational audio into coherent insights, quotes, and lessons in a way rule‑based systems cannot. They also support a conversational layer, allowing users to refine outputs via chat and generate personalized summaries, which increases user engagement.

The Solution

Marginalia turns podcast and audiobook highlights into structured, AI-generated takeaways. It captures:

1

1

Session-based capture flow:

users log a audio source, then add highlights with quotes, notes, and timestamps as they listen.

2

2

Integrated Spotify metadata lookup for auto-filling source details and cover art.

It generates:

3

3

Key insights distilled from the conversation

4

4

Best quotes worth remembering

5

5

Strategic lessons extracted and reframed as practical takeaways.

Marginalia takeaway page structure

Marginalia takeaway page structure

Metrics (Internal Testing)

I piloted Marginalia with an 18‑person UX book club as an internal test. These early signals suggested that AI‑generated summaries significantly improved recall and made post‑listening review more efficient.

80%

Quotes shared to the team quote board

2 min

Average reading time

faster review time compared to re-listening

AI Product Workflow

I used a four‑stage validation workflow to design and build Marginalia.

  1. Fake Door Test

Validate the idea

  • Interviewed 18 UX book club members to gauge interest and capture real listening pain points before building.

  • Ran market research on Reddit and Twitter to understand frustrations with existing podcast/audiobook summary tools (shallow summaries, poor navigation, weak quote support).

  • Used this to confirm demand for AI‑generated takeaways and to identify differentiation opportunities.

Marginalia opportunity map

Marginalia opportunity map

  1. Sandbox Test

2.1 Generate a PRD

Translated research into a PRD that defined target users, core jobs‑to‑be‑done, and the structure of the final “one‑page takeaway.”

PRD for Marginalia

PRD for Marginalia

2.2 Build a prototype

I vibe-coded the entire Marginalia prototype using Lovable.

Designed the AI generation pipeline to support:

Timestamp traceability

Every insight and quote links back to its original audio timestamp.

Timestamp traceability

One-page takeaway generator

Aggregates highlights into a structured summary.

One-page takeaway generator

Auto-generate quotes

Creates quotes from transcripts when users haven’t added manual highlights.

Auto-generate quotes

Conversational AI layer

Chat interface for follow‑up questions and on‑the‑fly reformats.

Conversational AI layer

3. User Flow Test

Validate the user experience

Once the AI output format was stable, I shared the prototype with the 18 UX book club member and gathered feedback. I then synthesized feedback through affinity mapping to identify friction points and opportunity areas in workflows.

UX Refinement Loop

I iterated in real time with a simulated prototype testing loop, refining both interaction details and the AI workflow.

Interaction accessibility

Updated hover states, focus styles, and contrast to meet WCAG AA where possible.

Interaction accessibility

Feedback and system status

Added loading dialogs and toast notifications to keep users informed during AI generation.

Feedback and system status

More intuitive user flow

Made all takeaway sections (insights, quotes, lessons) user‑editable and reorderable.

More intuitive user flow

AI user flow reformat

Replaced one‑click overwrite with auto‑detected reformat requests in chat plus an “Apply changes” confirmation step.

AI user flow reformat

  1. Product Analysis

Live product data tracking to identify the gap

Marginalia is live at Marginaliaclub.lovable.app, where I track real usage to help identify friction points and inform the next iterations.

Opportunity Map

Opportunity Map

Reflection

Takeaways

This was my first end‑to‑end “vibe‑coded” product, where I used AI tools to design, prototype, and ship a working app. Key learnings are:

💡AI accelerates the product lifecycle

Vibe coding dramatically reduced time from idea to functional prototype, enabling more cycles of user feedback.

💡UX fundamentals still matter

Even with AI‑generated UI and content, accessibility, hierarchy, and interaction details required deliberate design decisions.

💡Data closes the loop

Post‑launch analytics are essential for prioritizing UX improvements and validating that AI features actually drive better learning outcomes.

What's next

Supabase integration

Supabase integration

Add authentication and persistent storage so users can save, search, and return to their Marginalia library across sessions.

Add authentication and persistent storage so users can save, search, and return to their Marginalia library across sessions.

Personalized playlists

Personalized playlists

Connect to podcast subscriptions and automatically generate takeaways from a user’s playlist.

Connect to podcast subscriptions and automatically generate takeaways from a user’s playlist.

© 2026 by Lynn Qian