Super Long SEO Test:Tutorial Landing Page
Context: Previously we ran an SEO experiment where we added more content to the page. The result was a 35% boost in impressions. We would like to run a similar A/B test, this time with the current long form SEO vs a super long version of the page (and a new design).
Hypothesis: Having 1900+ words on the page will result in higher impressions and improved SEO rank. This will lead to increased sessions on our tutorial landing pages.
Design: https://www.figma.com/file/BUxQMWmpRGb5v7ijOtEKXU/Super-Long-SEO?node-id=47%3A571
Note: General copies and synonyms have all been created already. These are labeled in the Figma file.
Specs
This will be run as an A/B. Group A is the control (current content), Group B is super long content with a new design. Traffic to tutorial pages should randomly be split 50/50 between both groups.
Scenario: Group A (control) sees current content
Given I am in Group A
When I load a tutorial landing page
Then I see the current content
Scenario: All users see super long content
Given I am in on a tutorial landing page
When I load a tutorial landing page
Then I see the long form content and new design
Scenario: Group A page loads are tracked with a param
Given I am in Group A
When I load a tutorial landing page
Then I see “&groupA” in the URL
Scenario: Group B page loads are tracked with a param
Given I am in Group B
When I load a tutorial landing page
Then I see “&groupB” in the URL
Scenario: Only A/B on English tutorial landing pages
Given my language locale is anything other than English
When I load a tutorial landing page
Then I will see the current translated content
And I will not be in the A/B
Scenario: New content should be switchboarded
Given I am viewing a tutorial landing page
When I load the page for different apps or platforms
Then I should see different variations of each sentence, as per this Google Sheet
Scenario: Synonyms should be switched out
Given I am viewing a tutorial landing page
When I load the page for different apps or platforms
Then I should see different variations of individual keywords, as per this Google Sheet
Scenario: Synonyms should be capitalized if at the beginning of a sentence
Given I am viewing a tutorial landing page
When a synonym appears at the beginning of a sentence
Then it should be capitalized
Scenario: ‘Start now’ call to action should have the same behavior as CTAs on current tutorial landing pages
Given I am a website visitor to POWR
When I visit a tutorial landing page
Then the CTA in the top nav will say ‘Start Free’
And will redirect to the appropriate app market listing for the app/platform combination
Scenario: Top nav for logged in users
Given I am a logged in user
When I visit a tutorial landing page
Then the CTA in the top nav will say ‘Start Free’
And will redirect to the appropriate app market listing for the app/platform combination
Scenario: Top nav for logged out users
Given I am a logged out user
When I visit a tutorial landing page
Then the CTA in the top nav will say ‘Start Free’
And will redirect to the appropriate app market listing for the app/platform combination