Forum Discussion

Arshi8109's avatar
Arshi8109
New Member
7 months ago
Solved

Cold Start in Recommendation Models

How can we sold cold start user issue even we have send the user cohort signals also, without penalizing other users
  • deborshi_nag's avatar
    7 months ago

    Hi Arshi8109 

     

    Please use the following approach:

     

    • Global Baseline (safe, non-personalized)

      • Popularity & recency trends with minimal bias and diversity constraints.
      • Use catalog‑level controls (e.g., de-dupe, diversity by category/brand).
    • Cohort‑Aware Prior (hierarchical / Bayesian flavor)

      • Treat cohorts as priors on preferences, not hard filters.
      • Combine cohort priors with global baseline via learned weights (per cohort).
      • This avoids overfitting cohorts and preserves personalization as data accrues.
    • Content‑Based Recommendations (robust for item cold‑start too)

      • Build item embeddings from metadata (text, category, attributes) and optionally image features.
      • Recommend via nearest neighbors in embedding space; weight by cohort priors.
    • Lookalike Modeling (user embedding → nearest neighbor)

      • Map new users to similar existing users using shared signals (device, referrer, campaign, geography, time-of-day).
      • Use their top items as seed recommendations.
    • Contextual Bandits (controlled exploration for new users only)

      • Allocate a small exploration budget (e.g., 5–10%) for new users using contextual bandits (Thompson Sampling or LinUCB).
      • Keep bandit scope restricted to cold‑start segment; this avoids penalizing the rest.
    • Hybrid Model Router

      • A router decides for each request:
        • If user has ≥N events → warm-start (ALS/BPR/LTR).
        • Else → cold-start route (cohort prior + content KNN + bandit).
      • This isolation keeps warm users stable.
    • Graceful Handover

      • As interactions arrive, gradually shift from cold‑start mixture to warm‑start model via learned blending (e.g., a calibrated meta‑model).

     

    Avoid “Penalizing Other Users”: Design Principles

    1. Segmentation-based routing: Only new users hit the exploration policy.
    2. Budgeted exploration: Cap exploration impressions (e.g., 1–2 items per top‑N).
    3. Catalog‑safe baseline: Use a robust popularity baseline that does not change due to cold‑start policy shifts.
    4. Hierarchical priors (not hard rules): Cohort influence is additive, not exclusive.
    5. Counterfactual offline evaluation: Use IPS/SNIPS to estimate policy performance without risking production stability.
    6. Progressive personalization: Smoothly decay cohort weights as user-specific signals grow.

     

    Hope this helps! PLease mark as a Kudos or a Solution.