Push Copy Experiments
Variant hashes are computed via Digest::SHA256.hexdigest("#{title}#{body}")[0..7].
How to run
Create the experiment
1. Create a new Linear ticket.
Ensure that you set the team to Notifications. This will allow you to choose the push copy experiment template.
2. Fill out the details of the ticket.
3. Assign the ticket to an engineer, that engineer can assign the ticket to Cursor
Note only a user who has Github access to the handshake repo can assign the ticket to Cursor and have Cursor create the PR
4. Review PR
Review the PR to make sure the copy is correct and experiment set up is correct.
5. Start the experiment
If using Launch Darkly and Eppo set the appropriate targets and create the Eppo experiment.g
Notifications
Campaign Message
2026-03:
variant_b title varies by campaign type and institution context. Control body also varies by subclass (base: {sender_name} just messaged you).
| Variant | Hash | Copy | Session Lift | Winner |
|---|---|---|---|---|
| control | f354c826 | title: (none) body: {sender_name} just messaged you | ||
| variant_a | 94d6fbb7 | title: New message body: {truncated_message} | ||
| variant_b (standard) | 94d6fbb7 | title: New message body: {truncated_message} | ||
| variant_b (job) | eaf603e9 | title: New message about a job body: {truncated_message} | ||
| variant_b (career fair) | aa9cba69 | title: New message about a career fair body: {truncated_message} | ||
| variant_b (event) | aaff070f | title: New message about an event body: {truncated_message} | ||
| variant_b (with institution) | a9ee4e6b | title: New message from {institution_name} body: {truncated_message} |
Create Internal Message
2026-03:
| Variant | Hash | Copy | Session Lift | Winner |
|---|---|---|---|---|
| control/excluded | 5ee5ba86 | title: ✨Career Ping body: {sender_name} just reached out to you! | ||
| variant_a | 94d6fbb7 | title: New message body: {truncated_message} | 0.34% | ✅️ |
Job Recommendation Digest
2026-03:
| Variant | Hash | Copy | Session Lift | Winner |
|---|---|---|---|---|
| control/excluded | 4b9942d9 | title: 🔥 New week, new roles body: %{employer_name}, %{employer_name} + more | ||
| variant_a | c7e1ac16 | title: Top job picks for you body: %{employer_name}, %{employer_name} + more | 1.44% | ✅️ |
| variant_b | 81792bb4 | title: Fresh roles for you this week body: %{employer_name}, %{employer_name} + more | 0.85% | |
| variant_c | 13e0f72d | title: Your weekly job matches body: %{employer_name}, %{employer_name} + more | 0.67% |
New Job Alert / Approve Job Posting
2026-03-19:
| Variant | Hash | Copy | Session Lift | Winner |
|---|---|---|---|---|
| control/excluded | 5263ca37 | title: %{employer_name} is hiring body: New %{role} just posted | ✅️ | |
| variant_a | 5fa4ef65 | title: %{role_name} body: %{employer_name} is hiring | −0.02% |
2026-03:
| Variant | Hash | Copy | Session Lift | Winner |
|---|---|---|---|---|
| control/excluded | 60be4442 | title: 🚀 Be the first in line body: %{employer_name} is hiring—tap to apply | ||
| variant_a | 065644ae | title: Be first to apply body: %{employer_name} is hiring %{role} | 3.43% | |
| variant_b | 3353ec6b | title: %{employer_name} is hiring body: New %{role} just posted | 4.42% | ✅️ |
| variant_c | e3fceca3 | title: Just posted: %{role} body: New opening at %{employer_name} | 2.21% |
Saved Search / Digest Job Alert
2026-03:
| Variant | Hash | Copy | Session Lift | Winner |
|---|---|---|---|---|
| control/excluded | 10760b25 | title: ⚡️ %{count} new job body: New matches for "%{saved_search_name}" | ||
| variant_a | 7c5a8687 | title: Just posted: %{count} job body: "%{saved_search_name}": New roles from %{employer_name} | 9.66% | ✅️ |
| variant_b | 3bf731ca | title: New roles match your search body: %{count} new job for "%{saved_search_name}" | -0.32% |
2026-02:
| Variant | Hash | Copy | Session Lift | Winner |
|---|---|---|---|---|
| control/excluded | 10760b25 | title: ⚡️ %{count} new job body: New matches for "%{saved_search_name}" | ✅️ | |
| variant_a | a2a8666a | title: ⚡️ %{count} match for your search body: "%{saved_search_name}": New roles from %{employer_name} | 0.27% |
Unread Inbox Message Weekly Digest
2026-04:
| Variant | Hash | Copy | Session Lift | Winner |
|---|---|---|---|---|
| control | 632e59c6 | title: 🚨 Don't miss out! 📫 body: %{count} messages are waiting in your inbox | ||
| variant_a (with employer, 1 message) | bea7fcb1 | title: 1 unread message body: From %{employer_name} | 1.14% | ✅️ |
| variant_a (with employer, 2+ messages) | 156c5d61 | title: %{count} unread messages body: From %{employer_name} + others | ||
| variant_a (without employer) | 0a2dae50 | title: %{count} unread messages body: Check what you missed this week. |