alihan/browser-use
1
0
Fork 0
mirror of https://github.com/browser-use/browser-use.git synced 2025-02-18 01:18:20 +03:00
Code Issues Packages Projects Releases Wiki Activity
Files
89c63fdd63eb2301ab2c8a35be1d1f5d79afb9c1
browser-use/tests/mind2web_data/processed.json
Gregor Žunič 89c63fdd63 Added custom actions registry and fixed extraction layer (#20) 
* Validator

* Test mind2web

* Cleaned up logger

* Pytest logger

* Cleaned up logger

* Disable flag for human input

* Multiple clicks per button

* Multiple clicks per button

* More structured system prompt

* Fields with description

* System prompt example

* One logger

* Cleaner logging

* Log step in step function

* Fix critical clicking error - wrong argument used

* Improved thought process of agent

* Improve system prompt

* Remove human input message

* Custome action registration

* Pydantic model for custom actions

* Pydantic model for custome output

* Runs through, model outputs functions, but not called yet

* Work in progress - description for custome actions

* Description works, but schema not yet

* Model can call the right action - but is not executed

* Seperate is_controller_action  and is_custom_action

* Works! Model can call custom function

* Use registry for action, but result is not feed back to model

* Include result in messages

* Works with custom function - but typing is not correct

* Renamed registry

* First test cases

* Captcha tests

* Pydantic for tests

* Improve prompts for multy step

* System prompt structure

* Handle errors like validation error

* Refactor error handling in agent

* Refactor error handling in agent

* Improved logging

* Update view

* Fix click parameter to index

* Simplify dynamic actions

* Use run instead of step

* Rename history

* Rename AgentService to Agent

* Rename ControllerService to Controller

* Pytest file

* Rename get state

* Rename BrowserService

* reversed dom extraction recursion to while

* Rename use_vision

* Rename use_vision

* reversed dom tree items and made browser less anoying

* Renaming and fixing type errors

* Renamed class names for agent

* updated requirements

* Update prompt

* Action registration works for user and controller

* Fix done call by returning ActionResult

* Fix if result is none

* Rename AgentOutput and ActionModel

* Improved prompt Passes 6/8 tests from test_agent_actions

* Calculate token cost

* Improve display

* Simplified logger

* Test function calling

* created super simple xpath extraction algo

* Tests logging

* tiny fixes to dom extraction

* Remove test

* Dont log number of clicks

* Pytest file

* merged per element js checks

* Check if driver is still open

* super fast processing

* fixed agent planning and stuff

* Fix example

* Fix example

* Improve error

* Improved error correction

* New line for step

* small type error fixes

* Test for pydantic

* Fix line

* Removed sample

* fixed readme and examples

---------

Co-authored-by: magmueller <mamagnus00@gmail.com>
2024-11-15 21:42:02 +01:00

16858 lines
676 KiB
JSON
Raw Blame History

[
{
"website": "exploretock",
"id": "7bda9645-0b5f-470a-8dd7-6af0bff4da68",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Check for pickup restaurant available in Boston, NY on March 18, 5pm with just one guest",
"action_reprs": [
"[combobox] Reservation type -> SELECT: Pickup",
"[svg] -> CLICK",
"[searchbox] Find a location -> TYPE: Boston",
"[span] Boston -> CLICK",
"[svg] -> CLICK",
"[button] 18 -> CLICK",
"[combobox] Time -> SELECT: 5:00 PM",
"[svg] -> CLICK",
"[span] 2 guests -> CLICK",
"[combobox] Size -> SELECT: 1 guest",
"[button] Update search -> CLICK"
]
},
{
"website": "exploretock",
"id": "a6372f23-f462-4706-8455-5b350c46d83c",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Book a winery tour in Napa Valley in a winery which serves Mediterranean cuisine with wine testing for 4 guests on April 15, 10 am in a outdoor setup.",
"action_reprs": [
"[svg] -> CLICK",
"[svg] -> CLICK",
"[searchbox] Find a location -> TYPE: NAPA VALLEY",
"[span] Napa Valley -> CLICK",
"[combobox] Reservation type -> SELECT: Wineries",
"[svg] -> CLICK",
"[svg] -> CLICK",
"[button] 15 -> CLICK",
"[combobox] Time -> SELECT: 10:00 AM",
"[combobox] Party size -> SELECT: 4 guests",
"[svg] -> CLICK",
"[button] Edit cuisine type filter -> CLICK",
"[checkbox] Mediterranean -> CLICK",
"[button] Submit -> CLICK",
"[button] Open additional search filters -> CLICK",
"[checkbox] Outdoors -> CLICK",
"[checkbox] Wine tasting -> CLICK",
"[button] Update search -> CLICK",
"[span] 10:00 AM -> CLICK"
]
},
{
"website": "enterprise",
"id": "c0eeead1-f8ea-4819-a6da-ef0108b40c89",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Sign Allan Smith for email offers with the email allan.smith@gmail.com and zip code 10001",
"action_reprs": [
"[a] -> CLICK",
"[textbox] First Name (required) -> TYPE: Allan",
"[textbox] Last Name (required) -> TYPE: Smith",
"[textbox] Email Address (required) -> TYPE: allan.smith@gmail.com",
"[textbox] Confirm Email Address (required) -> TYPE: allan.smith@gmail.com",
"[textbox] ZIP Code (required) -> TYPE: 10001",
"[button] Submit -> CLICK"
]
},
{
"website": "enterprise",
"id": "ce34bc61-e3d2-40c8-b02b-b149efc4b115",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Find a mini van at Brooklyn City from April 5th to April 8th for a 22 year old renter.",
"action_reprs": [
"[searchbox] Pick-up & Return Location (ZIP, City or Airport) (... -> TYPE: Brooklyn",
"[option] Brooklyn, NY, US Select -> CLICK",
"[button] Selected Pick-Up Date 03/19/2023 -> CLICK",
"[button] 04/05/2023 -> CLICK",
"[svg] -> CLICK",
"[button] 04/08/2023 -> CLICK",
"[combobox] Renter Age -> SELECT: 22",
"[button] Vehicle Class -> CLICK",
"[radio] Minivans -> CLICK",
"[button] Apply Filter -> CLICK",
"[button] Browse Vehicles -> CLICK"
]
},
{
"website": "kohls",
"id": "bf469f30-6628-4017-b963-672645d7feab",
"domain": "Shopping",
"subdomain": "Department",
"confirmed_task": "Find the highest rated dog collar under 10 dollar.",
"action_reprs": [
"[link] Shop by Category -> CLICK",
"[link] Pet -> CLICK",
"[span] Pet Type -> CLICK",
"[link] Dog (1,338) -> CLICK",
"[span] Category -> CLICK",
"[link] Collars & Leashes (485) -> CLICK",
"[link] Sort by: Featured -> CLICK",
"[link] Highest Rated -> CLICK",
"[div] Price -> CLICK",
"[link] Under $10 (1) -> CLICK"
]
},
{
"website": "united",
"id": "9e035a36-1c77-4014-98ec-4d48ee41d904",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Compare the fare types to book a 1-adult ticket from Springfiels, IL to Austin, TX for April 29th 2023",
"action_reprs": [
"[combobox] Enter your departing city, airport name, or airpor... -> TYPE: SPRINGFIELD",
"[button] Springfield, IL, US (SPI) -> CLICK",
"[combobox] Enter your destination city, airport name, or airp... -> TYPE: AUSTIN",
"[button] Austin, TX, US (AUS) -> CLICK",
"[span] -> CLICK",
"[button] Find flights -> CLICK",
"[textbox] Date -> CLICK",
"[button] Move backward to switch to the previous month. -> CLICK",
"[button] Saturday, April 29, 2023 -> CLICK",
"[button] Update -> CLICK",
"[link] Details -> CLICK",
"[link] Seats -> CLICK"
]
},
{
"website": "budget",
"id": "cf361c84-6414-4b05-a7a1-77383997150a",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Get an SUV with an additional driver and wifi for pick up in any rental location near Washington regional airport on June 1, 11 am, and drop off at Washington international airport on June 2, 11 am, and pay for the booking instantly.",
"action_reprs": [
"[button] Locations -> HOVER",
"[link] Find a Location -> CLICK",
"[textbox] Search by Airport, City, Zip, Address or Attractio... -> TYPE: washington",
"[span] Washington County Regional Apo -> CLICK",
"[link] Make a Reservation -> CLICK",
"[textbox] mm/dd/yyyy -> CLICK",
"[link] Next -> CLICK",
"[link] 1 -> CLICK",
"[link] 2 -> CLICK",
"[combobox] Pick Up Time -> SELECT: 11:00 AM",
"[combobox] Return Time -> SELECT: 11:00 AM",
"[textbox] Return to same location -> TYPE: washington",
"[div] Washington Dulles Intl Airport -> CLICK",
"[generic] Vehicle Type * -> CLICK",
"[p] SUVs & Wagons -> CLICK",
"[button] Select My Car -> CLICK",
"[link] Pay Now -> CLICK",
"[checkbox] $21.99/Day -> CLICK",
"[checkbox] $13.00/Day -> CLICK",
"[button] Continue -> CLICK"
]
},
{
"website": "underarmour",
"id": "46a3683f-fbe0-40d0-8729-6c7964d994e6",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Find a men's UA outlet T-shirt of XL size and add to cart.",
"action_reprs": [
"[menuitem] Outlet -> CLICK",
"[link] Mens -> CLICK",
"[div] Product Category -> CLICK",
"[link] Clothing -> CLICK",
"[div] Product Type -> CLICK",
"[link] Short Sleeves -> CLICK",
"[div] Size -> CLICK",
"[link] XL -> CLICK",
"[img] Men's UA Tech\u2122 2.0 Short Sleeve -> CLICK",
"[button] XL -> CLICK",
"[button] Add to Bag -> CLICK"
]
},
{
"website": "kohls",
"id": "4b2030ff-b83c-445f-bf87-9c8fbc68498b",
"domain": "Shopping",
"subdomain": "Department",
"confirmed_task": "Browse for wall art with a price range of $25 to $50.",
"action_reprs": [
"[textbox] Search by keyword or web id -> TYPE: wall art",
"[input] -> CLICK",
"[link] Wall Art -> CLICK",
"[div] Price -> CLICK",
"[link] $25 to $50 (5,006) -> CLICK"
]
},
{
"website": "kohls",
"id": "4bc70fa1-e817-405f-b113-0919e8e94205",
"domain": "Shopping",
"subdomain": "Department",
"confirmed_task": "Add the cheapest Women's Sweaters to my shopping cart.",
"action_reprs": [
"[span] Shop by Category -> CLICK",
"[link] Women -> HOVER",
"[link] Sweaters & Cardigans -> CLICK",
"[link] Sort by: Featured -> CLICK",
"[link] Price Low-High -> CLICK",
"[p] Women's Sonoma Goods For Life\u00ae All Over Stitch -> CLICK",
"[button] Add to Cart -> CLICK"
]
},
{
"website": "kayak",
"id": "b20e1dc4-651b-46e1-8470-16250657f2a8",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find a cheapest SUV in Brooklyn for 1 day.",
"action_reprs": [
"[link] Search for cars -> CLICK",
"[textbox] Pick-up location -> CLICK",
"[textbox] Pick-up location -> TYPE: Brooklyn",
"[span] Brooklyn, New York, United States -> CLICK",
"[span] Different drop-off -> CLICK",
"[tab] Same drop-off -> CLICK",
"[button] End date -> CLICK",
"[button] May 22, 2023 -> CLICK",
"[svg] -> CLICK",
"[img] SUV -> CLICK",
"[div] $75 -> CLICK",
"[div] View Deal -> HOVER"
]
},
{
"website": "kayak",
"id": "d63b1715-688c-4be2-b196-dde9659bc59d",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "From Birmingham (BHX) to Paris search for packages with casinos, restaurant, fitness and a free internet from April 7th to 11th.",
"action_reprs": [
"[link] Search for packages -> CLICK",
"[textbox] From -> TYPE: Birmingham",
"[span] Birmingham, England, United Kingdom -> CLICK",
"[textbox] Enter destination or airport -> TYPE: Paris",
"[span] City -> CLICK",
"[generic] Tuesday April 4th -> CLICK",
"[div] 7 -> CLICK",
"[button] Tuesday April 11, 2023 -> CLICK",
"[svg] -> CLICK",
"[checkbox] Free internet -> CLICK",
"[button] Amenities -> CLICK",
"[checkbox] Casino -> CLICK",
"[checkbox] Restaurant -> CLICK",
"[checkbox] Fitness -> CLICK"
]
},
{
"website": "rottentomatoes",
"id": "d1942a73-745f-44c5-ba30-0d0c7925f5d2",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Find a comedy movie streaming on Netflix and add to watchlist.",
"action_reprs": [
"[link] MOVIES -> HOVER",
"[link] Netflix streaming -> CLICK",
"[svg] -> CLICK",
"[div] -> CLICK",
"[button] APPLY -> CLICK",
"[img] Chris Rock: Selective Outrage -> CLICK",
"[button] WANT TO SEE -> CLICK"
]
},
{
"website": "parking",
"id": "8e849b85-5acc-4d26-ad5e-d24ad24343df",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Book parking spot for James SMith at Stewart Hotel in New York for 2 hours. The street address is 133 st avenue in New York. Zip code is 10001 and phone number is 888888888. The email address is buckeye.foobar@gmail.com. Employer's name is Gua AB.",
"action_reprs": [
"[span] Enter an Address or Venue to find parking -> CLICK",
"[span] Enter an Address or Venue to find parking -> TYPE: stewart hotel",
"[option] STEWART HOTEL\u00a0\u00a0148 W 31st Street, New York Parking... -> CLICK",
"[link] BOOK MONTHLY PARKING -> CLICK",
"[textbox] First Name -> CLICK",
"[textbox] First Name -> TYPE: James",
"[textbox] Last Name -> TYPE: SMith",
"[textbox] Address1 -> TYPE: 133 st avenue",
"[textbox] City Name -> TYPE: New York",
"[select] Alabama -> SELECT: New York",
"[textbox] Zip Code -> TYPE: 10001",
"[textbox] (###) ###-#### -> TYPE: 888888888",
"[textbox] Email Address -> TYPE: buckeye.foobar@gmail.com",
"[textbox] Email Address -> TYPE: buckeye.foobar@gmail.com",
"[textbox] Employer Name -> CLICK",
"[textbox] Employer Name -> TYPE: Gua AB",
"[button] Submit -> CLICK"
]
},
{
"website": "parking",
"id": "9ed8cd2a-b0f8-4ccf-9d48-1ddfba4f5e58",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find motorcycle parking near Radio City Music Hall.",
"action_reprs": [
"[span] Enter an Address or Venue to find parking -> TYPE: radio city music hall",
"[em] Music -> CLICK",
"[strong] Filters -> CLICK",
"[checkbox] Motorcycle Parking -> CLICK",
"[link] View Details ROCKEFELLER CENTER -> CLICK"
]
},
{
"website": "parking",
"id": "a31de393-c6e0-4175-858b-03cdc435d585",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Browse events happening at Madison Square Garden.",
"action_reprs": [
"[combobox] \uf002\u00a0 Enter an Address or Venue to find parking -> TYPE: Madison Square Garden",
"[em] Madison -> CLICK"
]
},
{
"website": "parking",
"id": "a5c1095b-bba1-4029-8b8d-fa5848702827",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find parking in New York City from June 5th to 9th.",
"action_reprs": [
"[span] Enter an Address or Venue to find parking -> TYPE: New York City",
"[option] New York City\u00a0\u00a0 City -> CLICK",
"[span] Mar 9 -> CLICK",
"[i] -> CLICK",
"[i] -> CLICK",
"[i] -> CLICK",
"[gridcell] 5 -> CLICK",
"[span] Jun 5 -> CLICK",
"[gridcell] 9 -> CLICK",
"[button] SEARCH -> CLICK"
]
},
{
"website": "amtrak",
"id": "b910229f-6133-452c-a640-6a6ec67b668b",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Get quote for Amtrak vacation for two adults across country while leaving from Chicago on the 22nd of April. It should include Deluxe bedroom. The passenger is named John Mark with email address of johnmark@gmail.com and phone number of 234567890.",
"action_reprs": [
"[button] DEALS -> CLICK",
"[link] VACATIONS & RAIL TOURS Train vacation packages thr... -> CLICK",
"[img] -> CLICK",
"[link] Close -> CLICK",
"[button] Instant Quote -> CLICK",
"[textbox] What city would you like to depart from? -> TYPE: Chicago",
"[checkbox] I'm interested in the reverse trip of the selected... -> CLICK",
"[checkbox] Deluxe Bedroom -> CLICK",
"[button] Continue -> CLICK",
"[link] Close -> CLICK",
"[textbox] *Preferred date of travel -> CLICK",
"[link] 22 -> CLICK",
"[button] Continue -> CLICK",
"[div] + -> CLICK",
"[textbox] About Your Trip: -> TYPE: Wedding Anniversary",
"[button] Continue -> CLICK",
"[textbox] *First Name -> TYPE: John",
"[textbox] *Last Name -> TYPE: Mark",
"[textbox] *Email Address -> TYPE: Johnmark@gmail.com",
"[textbox] *Phone Number -> TYPE: 234567890",
"[label] I am NOT a Travel Advisor. -> CLICK",
"[button] Submit Quote Request -> HOVER"
]
},
{
"website": "amazon",
"id": "f754d919-2191-464e-a407-0f3da9409081",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "See today's deals on video games and find the best deal on the lowest-priced mouse.",
"action_reprs": [
"[button] Open Menu -> CLICK",
"[link] Movies, Music & Games -> CLICK",
"[link] Video Games -> CLICK",
"[link] Today's Deals -> CLICK",
"[link] PC -> CLICK",
"[link] Accessories -> CLICK",
"[link] Gaming Mice -> CLICK",
"[span] Featured -> CLICK",
"[option] Price: Low to High -> CLICK"
]
},
{
"website": "amazon",
"id": "fc21339a-5dc0-489c-b348-2fac79483f76",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Find Metformin 1000mg tablet price and details.",
"action_reprs": [
"[button] Open Menu -> CLICK",
"[link] See All -> CLICK",
"[link] Amazon Health -> CLICK",
"[link] Amazon Pharmacy -> CLICK",
"[span] Type your medication name -> TYPE: Metformin 1000mg",
"[li] metformin 1000mg tablet -> CLICK",
"[img] Metformin (Generic for Glucophage, Oral Tablet) -> CLICK"
]
},
{
"website": "kohls",
"id": "1c8b3d98-ffcf-42b9-ae0b-73d22d87bad7",
"domain": "Shopping",
"subdomain": "Department",
"confirmed_task": "Add a pair of diamond stud earrings to the cart.",
"action_reprs": [
"[textbox] Search by keyword or web id -> TYPE: diamond stud earrings",
"[span] diamond stud earrings -> CLICK",
"[img] 10k Gold 1 Carat T.W. Black Diamond Stud Earrings -> CLICK",
"[button] Add to Cart -> CLICK"
]
},
{
"website": "underarmour",
"id": "6407babe-fe48-492a-8211-1f22a81b9ac0",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Find men's running shoes of size 9 with lowest price and add to bag.",
"action_reprs": [
"[menuitem] Men -> CLICK",
"[link] Shoes -> CLICK",
"[link] Running -> CLICK",
"[div] Size -> CLICK",
"[link] 9 -> CLICK",
"[span] Now Trending -> CLICK",
"[li] Price (Low - High) -> CLICK",
"[img] Men's UA Surge 3 Running Shoes -> CLICK",
"[button] 9 -> CLICK",
"[button] Add to Bag -> CLICK"
]
},
{
"website": "rottentomatoes",
"id": "5092fad7-ff8a-481e-bb0b-fe83590193ce",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Show reviews of top critics for lowest rated Tom Hanks work",
"action_reprs": [
"[textbox] Search -> TYPE: Tom Hanks",
"[p] Tom Hanks -> CLICK",
"[link] My Life in Ruins (2009) -> CLICK",
"[link] Top Critics (49) -> CLICK"
]
},
{
"website": "us.megabus",
"id": "14b5885e-5454-465f-92bf-d8f7315c4a46",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find a ticket from Abbotsford to Sheboygan on March 26, 2023.",
"action_reprs": [
"[button] Explore\ue911 -> CLICK",
"[link] Route map -> CLICK",
"[textbox] Pick an origin Pick a destination -> TYPE: Abbotsford",
"[span] Abbotsford, WI -> CLICK",
"[textbox] Enter a town, city or zipcode -> TYPE: Sheboygan",
"[span] Sheboygan, WI -> CLICK",
"[button] Search -> CLICK",
"[input] -> CLICK",
"[gridcell] March 26, 2023 -> CLICK",
"[button] Find tickets -> CLICK"
]
},
{
"website": "us.megabus",
"id": "1538e37b-9c33-48b0-b10e-662e192ad53a",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find bus stops in Alanson, MI",
"action_reprs": [
"[button] Explore\ue911 -> CLICK",
"[link] Bus stops -> CLICK",
"[button] Alanson, MI \ue911 -> CLICK"
]
},
{
"website": "us.megabus",
"id": "21e5c264-df85-4055-a566-ecb65cdd8c63",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Add to my basket tickets for 3 people from New York to Alfred.",
"action_reprs": [
"[textbox] From (type text or use the arrow keys) -> TYPE: New York",
"[span] New York, NY -> CLICK",
"[textbox] To (type text or use the arrow keys) -> TYPE: Alfred",
"[span] Alfred, NY -> CLICK",
"[textbox] Pick a date -> CLICK",
"[gridcell] March 31, 2023 -> CLICK",
"[span] -> CLICK",
"[span] -> CLICK",
"[button] Find tickets -> CLICK",
"[button] Add to basket -> CLICK"
]
},
{
"website": "carmax",
"id": "8e721b00-f406-449b-9885-0267b47ecfdb",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Search for used Jaguar XFs with no black exterior color and save the search as Jaguar to get a notification daily.",
"action_reprs": [
"[searchbox] Search make, model, or keyword -> TYPE: jaguar xf",
"[link] Jaguar XF -> CLICK",
"[button] Advanced Search -> CLICK",
"[textbox] Ex. Black exterior -> TYPE: black",
"[button] Black (Exterior Color) -> CLICK",
"[button] SAVE SEARCH -> CLICK",
"[textbox] Custom name your search -> TYPE: Jaguar",
"[button] CONTINUE -> CLICK",
"[radio] Daily summary -> CLICK",
"[button] CONTINUE -> CLICK"
]
},
{
"website": "viator",
"id": "f27bb47e-3aba-439a-b98a-2cf9b0e25e9c",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Browse Tokyo's best tea related attractions in the morning.",
"action_reprs": [
"[span] Explore the World -> HOVER",
"[span] Tokyo -> CLICK",
"[link] Food & Drink -> CLICK",
"[link] Coffee & Tea -> CLICK",
"[label] 6am\u201412pm -> CLICK"
]
},
{
"website": "kohls",
"id": "5a15ea92-571d-4a45-ad18-5b4eddbc70a6",
"domain": "Shopping",
"subdomain": "Department",
"confirmed_task": "Get the lowest priced plus size one piece active swimsuit in color black.",
"action_reprs": [
"[link] Shop by Category -> CLICK",
"[link] Women -> HOVER",
"[link] Swimwear -> CLICK",
"[link] Women's Plus -> CLICK",
"[div] Color -> CLICK",
"[link] Black (294) -> CLICK",
"[link] Sort by: Featured -> CLICK",
"[link] Price Low-High -> CLICK",
"[div] Occasion -> CLICK",
"[link] Active (6) -> CLICK"
]
},
{
"website": "delta",
"id": "1860601a-faef-4dba-8cbb-807ea8434dca",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Check for travel requirements when travelling from New York to Tokyo as US citizen.",
"action_reprs": [
"[tab] Travel Info -> CLICK",
"[link] Travel Planning Center -> CLICK",
"[button] Find Your Destination -> CLICK",
"[link] Explore Destinations & Travel Requirements -> CLICK",
"[combobox] Origin -> CLICK",
"[combobox] Origin -> TYPE: New York",
"[p] New York City -> CLICK",
"[combobox] Destination -> CLICK",
"[combobox] Destination -> TYPE: Tokyo",
"[span] (HND) -> CLICK",
"[combobox] Nationality -> CLICK",
"[option] United States of America (USA) -> CLICK",
"[combobox] Vaccination status Vaccination status -> CLICK",
"[option] Fully vaccinated -> CLICK",
"[button] Search -> CLICK"
]
},
{
"website": "underarmour",
"id": "5e47dc3e-2a4a-4273-871d-dfdb33b091d5",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Filter women's sports bras that are purple with high support that are small size.",
"action_reprs": [
"[menuitem] Women -> CLICK",
"[link] Sports Bras -> CLICK",
"[div] Size -> CLICK",
"[link] S -> CLICK",
"[div] Filter -> CLICK",
"[RootWebArea] Women's Sports Bras | Under Armour -> CLICK",
"[button] Show more -> CLICK",
"[div] Color -> CLICK",
"[link] Refine by color: Purple -> CLICK",
"[div] Support Level -> CLICK",
"[link] High Support -> CLICK"
]
},
{
"website": "ultimate-guitar",
"id": "1943febc-0635-4124-871c-578c4d9f5a44",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Find the most popular guitar tab for Absolute Beginners.",
"action_reprs": [
"[link] Tabs -> CLICK",
"[svg] -> CLICK",
"[link] Most popular of all time -> CLICK",
"[link] Absolute Beginner 91,138 -> CLICK",
"[link] You Belong With Me (ver\u00a02) -> CLICK"
]
},
{
"website": "ultimate-guitar",
"id": "1a35becb-e07b-4235-8cd3-fc2a29f8dd6f",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Add the most most popular of all time tab to a playlist",
"action_reprs": [
"[link] Tabs -> CLICK",
"[link] Tab -> CLICK",
"[svg] -> CLICK",
"[link] Most popular of all time -> CLICK",
"[link] Stairway To Heaven -> CLICK",
"[button] ADD TO PLAYLIST -> CLICK"
]
},
{
"website": "ticketcenter",
"id": "904bd858-1c40-4d22-9a5b-e2974c3b5a7e",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Find the most expensive ticket for New York Knicks game on April 9",
"action_reprs": [
"[textbox] Search for artists, teams or venues... -> CLICK",
"[textbox] Search for artists, teams or venues... -> TYPE: New york knicks",
"[option] New York Knicks -> CLICK",
"[link] TICKETS -> CLICK",
"[span] -> CLICK",
"[div] Price - High to Low -> CLICK"
]
},
{
"website": "ticketcenter",
"id": "9b18e5e4-4873-49bf-b422-c3f5bc5d1f33",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Book a WWE ticket for price range between $50 to $100.",
"action_reprs": [
"[link] WWE Tickets -> CLICK",
"[link] TICKETS -> CLICK",
"[p] $41 - $1,255 -> CLICK",
"[input] -> TYPE: 50",
"[input] -> TYPE: 100",
"[button] Done -> CLICK",
"[button] $50/ea -> CLICK"
]
},
{
"website": "sixflags",
"id": "930803d7-4032-4144-89a2-e44f3c5c9ccf",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Buy tickets for a group at Hurricane harbor Phoenix on April 22",
"action_reprs": [
"[button] Browse the Parks Below -> CLICK",
"[span] Hurricane Harbor Phoenix -> CLICK",
"[button] Go! -> CLICK",
"[link] Groups \ue92e -> CLICK",
"[span] Buy Now -> CLICK",
"[button] April 22, 2023 -> CLICK",
"[button] Buy Now -> CLICK"
]
},
{
"website": "sixflags",
"id": "a11022ab-f733-4295-a2f2-0da19cccc1b4",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Sign up for emails using the name Dick Smith and the email smith@gmail.com, select Six Flags Magic Mountain as the Park of Preference,",
"action_reprs": [
"[textbox] First Name -> TYPE: Dick",
"[textbox] Last Name -> TYPE: Smith",
"[textbox] Email -> TYPE: smith@gmail.com",
"[combobox] Park of Preference -> SELECT: Six Flags Magic Mountain / Los Angeles, CA",
"[button] Sign Up -> CLICK"
]
},
{
"website": "viator",
"id": "d6dd19a2-c57e-4e4d-b7e1-8919a86f1157",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Book the cheapest likely to sell out activity in Los Angeles on April 2",
"action_reprs": [
"[textbox] Where to? -> TYPE: Los Angeles",
"[b] Los Angeles -> CLICK",
"[button] Next -> CLICK",
"[gridcell] Sun Apr 02 2023 -> CLICK",
"[circle] -> CLICK",
"[link] Likely To Sell Out -> CLICK",
"[svg] -> CLICK",
"[span] Price (Low to High) -> CLICK",
"[link] Hollywood Sign Hiking Tour to Griffith Observatory -> CLICK"
]
},
{
"website": "rei",
"id": "70b3ef5b-d900-44cf-9b62-9ecece97954c",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find climbing gear and sort the results by price high to low.",
"action_reprs": [
"[button] Climb -> CLICK",
"[button] Climb -> CLICK",
"[link] Explore Climb -> CLICK",
"[link] Shop all climbing gear -> CLICK",
"[combobox] Sort By -> SELECT: Price: High - Low"
]
},
{
"website": "newegg",
"id": "987b25a8-05af-4b18-bd5b-7e2ccba5fb1e",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "Add Western Digital internal SSD with 1TB storage and 8GB Ram DDR to the cart.",
"action_reprs": [
"[searchbox] Search Site -> CLICK",
"[searchbox] Search Site -> TYPE: Western Digital internal SSD 1 TB",
"[button] \uf002 -> CLICK",
"[link] Western Digital WD_BLACK SN770 M.2 2280 1TB PCIe G... -> CLICK",
"[button] ADD TO CART \uf0da -> CLICK",
"[button] NO, THANKS -> CLICK",
"[button] Close -> CLICK",
"[searchbox] Search Site -> TYPE: 8GB Ram",
"[button] \uf002 -> CLICK",
"[img] 8GB (1x8GB) DDR3L 1600 (PC3L-12800) Desktop Memory... -> CLICK",
"[button] ADD TO CART \uf0da -> CLICK",
"[button] NO, THANKS -> CLICK"
]
},
{
"website": "imdb",
"id": "de1045f4-14ce-4de9-9aa8-601315b73b0e",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Get the most popular documentary tv series sorted by IMDB rating, see the details of the top result.",
"action_reprs": [
"[button] Open Navigation Drawer -> CLICK",
"[span] Browse TV Shows by Genre -> CLICK",
"[link] Documentary -> CLICK",
"[link] User Rating -> CLICK",
"[link] Going Postal -> CLICK"
]
},
{
"website": "imdb",
"id": "f2f531ff-94d5-4320-8594-7ae5d3a52af5",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Show top 50 Movies and TV shows by Sci fi genre.",
"action_reprs": [
"[path] -> CLICK",
"[span] Top 250 Movies -> CLICK",
"[link] Sci-Fi -> CLICK",
"[button] Open Navigation Drawer -> CLICK",
"[span] Top 250 TV Shows -> CLICK",
"[link] Sci-Fi -> CLICK"
]
},
{
"website": "ign",
"id": "39b037ac-0a11-4b05-8919-b4f9863fd0cd",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Show review of Prometheus movie.",
"action_reprs": [
"[path] -> CLICK",
"[tab] MOVIES -> CLICK",
"[searchbox] Search -> TYPE: Prometheus",
"[div] Prometheus -> CLICK",
"[tab] Reviews -> CLICK"
]
},
{
"website": "ign",
"id": "3be7acd4-c8c4-4e0d-b2b6-f82a4e17de8c",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Open the Resident evil 4 game guide.",
"action_reprs": [
"[path] -> CLICK",
"[link] Guides -> CLICK",
"[button] Open Guide -> CLICK"
]
},
{
"website": "instacart",
"id": "14a4e19d-d82d-45dd-b4f0-6b60ed87d085",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Find nearest Sprouts Farmers Market and add two fruits and one sauce from the deals.",
"action_reprs": [
"[img] -> CLICK",
"[link] Deals -> CLICK",
"[div] Add -> CLICK",
"[span] Add -> CLICK",
"[link] View More -> CLICK",
"[div] Add -> CLICK"
]
},
{
"website": "instacart",
"id": "15a0ffe5-8462-4a8e-8938-91b05a40756f",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Add a new address to the account. The address is 2983 Marietta Street, APT 2. Business name is Buck.",
"action_reprs": [
"[span] 171 2nd street -> CLICK",
"[textbox] Add a new address -> TYPE: 2983 Marietta Street",
"[span] 2983 Marietta Street -> CLICK",
"[textbox] Apt, floor, suite, etc (optional) -> TYPE: 2",
"[textbox] Business name (optional) -> TYPE: Buck",
"[button] Save Address -> CLICK"
]
},
{
"website": "instacart",
"id": "277bdab6-e924-45dd-ba26-d659d864d671",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Add 2 different flavor dog treats and one dog food with lowest price to cart from Safeway.",
"action_reprs": [
"[textbox] Search -> TYPE: dog treats",
"[span] dog treats -> CLICK",
"[span] View all 20+ items -> CLICK",
"[span] Best match -> CLICK",
"[option] Price: lowest first -> CLICK",
"[span] Add -> CLICK",
"[span] Add -> CLICK",
"[button] Load more -> CLICK",
"[span] Add to cart -> CLICK"
]
},
{
"website": "redbox",
"id": "c82bd6d6-6f08-4f1d-aeef-351c86694bbc",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Find the newest movies for rent in the Redbox kiosk at any Winn Dixie in Daytona Beach.",
"action_reprs": [
"[button] Navigate to Find a kiosk nearby -> CLICK",
"[textbox] City or ZIP Code -> TYPE: Daytona",
"[button] select to search for a kiosk using city or zipcode -> CLICK",
"[button] select to browse a kiosk -> CLICK",
"[button] Show Filters -> CLICK",
"[button] Filter by rent -> CLICK",
"[span] Hide Filters -> CLICK",
"[path] -> CLICK",
"[combobox] sortBy -> SELECT: Newest"
]
},
{
"website": "booking",
"id": "754c8c29-92b6-4af1-9594-f9d3da37b951",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Find a 3-star rated hostel with balcony and free cancellation option in Udipi, Karnataka for one person under 50 dollars from June 15 to 20, free wifi is compulsory.",
"action_reprs": [
"[link] Hostels -> CLICK",
"[searchbox] Please type your destination -> TYPE: udupi",
"[option] Udupi Karnataka,\u00a0India -> CLICK",
"[span] 25 -> CLICK",
"[svg] -> CLICK",
"[checkbox] 15 June 2023 -> CLICK",
"[checkbox] 20 June 2023 -> CLICK",
"[span] 2 adults -> CLICK",
"[button] - -> CLICK",
"[button] Search -> CLICK",
"[span] -> CLICK",
"[span] -> CLICK",
"[span] -> CLICK",
"[span] -> CLICK",
"[button] Show all 25 -> CLICK",
"[span] -> CLICK",
"[button] Sort by:Top picks for solo travellers -> CLICK",
"[button] Price (lowest first) -> CLICK",
"[link] See availability -> CLICK",
"[button] Reserve -> CLICK",
"[button] I'll\u00a0reserve -> CLICK"
]
},
{
"website": "ticketcenter",
"id": "2bce1096-f573-4752-94a9-e139ce37eb27",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Find the list of off-Broadway theatre shows on April 19",
"action_reprs": [
"[button] THEATRE -> CLICK",
"[link] Off-Broadway -> CLICK",
"[button] All dates -> CLICK",
"[textbox] Select Date Range -> CLICK",
"[gridcell] 19 -> CLICK",
"[input] -> CLICK",
"[gridcell] 19 -> CLICK",
"[button] Apply -> CLICK"
]
},
{
"website": "ticketcenter",
"id": "4d73937b-3be7-4f5f-950f-b1905244a2ac",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Show MLB tickets for this weekend and select the next one.",
"action_reprs": [
"[button] SPORTS -> HOVER",
"[link] All MLB Tickets -> CLICK",
"[button] All dates -> CLICK",
"[link] This weekend -> CLICK",
"[link] TICKETS -> CLICK"
]
},
{
"website": "ticketcenter",
"id": "5199e802-2fce-448d-8859-3cdf57b8dada",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Go to the list of ballet event for the next 30 days.",
"action_reprs": [
"[textbox] Search for artists, teams or venues... -> TYPE: Ballet",
"[button] Search -> CLICK",
"[button] All dates -> CLICK",
"[link] Next 30 days -> CLICK"
]
},
{
"website": "ticketcenter",
"id": "549452ab-637a-4997-bce1-5898541bb288",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Show me all NFL tickets",
"action_reprs": [
"[button] SPORTS -> HOVER",
"[tab] NFL -> HOVER",
"[link] All NFL Tickets -> CLICK"
]
},
{
"website": "ticketcenter",
"id": "55631305-2957-4343-b4f7-73aa68acba47",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Buy two tickets for the Boston Red Sox vs. New York Yankees game on August 18th, with a total cost of no more than $200.",
"action_reprs": [
"[textbox] Search for artists, teams or venues... -> TYPE: red sox vs yankees",
"[button] Search -> CLICK",
"[link] TICKETS -> CLICK",
"[span] -> CLICK",
"[label] 2 -> CLICK",
"[span] -> CLICK",
"[input] -> TYPE: 200",
"[span] Prices with Fees -> CLICK",
"[button] Done -> CLICK",
"[button] $83.95/ea -> CLICK"
]
},
{
"website": "uniqlo",
"id": "13f1648c-9de8-497d-bed3-02096206dc5f",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Add two pairs of women's Pink sweet pants in XXL size to your cart and view your cart.",
"action_reprs": [
"[link] WOMEN -> CLICK",
"[tab] Bottoms -> CLICK",
"[link] Pants -> CLICK",
"[gridcell] Category -> CLICK",
"[input] -> CLICK",
"[option] Sweatpants -> CLICK",
"[heading] Sweatpants -> CLICK",
"[checkbox] PINK -> CLICK",
"[checkbox] XXL -> CLICK",
"[input] -> CLICK",
"[option] 2 -> CLICK",
"[button] ADD TO CART -> CLICK",
"[button] VIEW CART -> CLICK"
]
},
{
"website": "airbnb",
"id": "1267fbd8-54c8-4f2e-8471-b13c4de332c7",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Search for a tiny home anywhere for an adult and 2 pets to stay in from april 10 to april 12",
"action_reprs": [
"[path] -> CLICK",
"[span] Tiny homes -> CLICK",
"[button] Check in / Check out Any week -> CLICK",
"[button] 10, Monday, April 2023. Available. Select as check... -> CLICK",
"[button] 12, Wednesday, April 2023. Available. Select as ch... -> CLICK",
"[div] Add guests -> CLICK",
"[svg] -> CLICK",
"[svg] -> CLICK",
"[path] -> CLICK",
"[span] -> CLICK"
]
},
{
"website": "tesla",
"id": "851ed4e6-51ee-47ad-a861-a28bdc61a102",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Open the page to schedule a Model X test drive.",
"action_reprs": [
"[button] Menu -> CLICK",
"[link] Demo Drive -> CLICK",
"[button] Model X -> CLICK"
]
},
{
"website": "tesla",
"id": "8e7b05d4-7dfb-4345-af2b-3e1dcd1c2ea2",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Show me a map with charging stations in London.",
"action_reprs": [
"[button] Menu -> CLICK",
"[link] Charging -> CLICK",
"[link] Find Us -> CLICK",
"[textbox] search input -> TYPE: London",
"[li] London, UK -> CLICK"
]
},
{
"website": "tesla",
"id": "9cd20dc6-d2a5-4e8f-9252-549f2c51413c",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "View inventory of Tesla Model S that are blue and new with 19\" wheels within 50 miles of zip code 60602.",
"action_reprs": [
"[link] Model S -> CLICK",
"[link] View Inventory -> CLICK",
"[image] -> CLICK",
"[checkbox] 19\" Wheels -> CLICK",
"[textbox] Registration Zip Code Where you will register the ... -> TYPE: 60602",
"[combobox] Search within -> SELECT: 50 miles"
]
},
{
"website": "tesla",
"id": "cdbd410d-170a-426d-b6d2-60dafaffe853",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Show me the best seller accessories for the Model X",
"action_reprs": [
"[link] Shop -> CLICK",
"[link] Shop Now -> CLICK",
"[heading] Best Sellers -> CLICK"
]
},
{
"website": "tesla",
"id": "e12f51f6-c8c5-4a68-9586-d77927bca79c",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Add a Tesla Shop Gift Card for April May with the email april.may@gmail.com to my cart",
"action_reprs": [
"[link] Shop -> CLICK",
"[menuitem] Lifestyle -> CLICK",
"[img] Tesla Shop Gift Card -> CLICK",
"[textbox] Name of Recipient -> TYPE: April May",
"[textbox] Email Address of Recipient -> TYPE: april.may@gmail.com",
"[button] Add to Cart -> CLICK"
]
},
{
"website": "tesla",
"id": "e2142cde-5bec-46ee-8d17-9b6ee52a66e8",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Show me the inventory of the Tesla Model S within 200 miles from 10001",
"action_reprs": [
"[link] Model S -> CLICK",
"[link] View Inventory -> CLICK",
"[textbox] Registration Zip Code Where you will register the ... -> TYPE: 10001",
"[combobox] Search within -> SELECT: 200 miles"
]
},
{
"website": "tesla",
"id": "e6bdb364-4327-44f0-a6d8-94eb00b36ca7",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Go to the page with help in choosing a solar energy product for homes.",
"action_reprs": [
"[link] Solar Panels -> CLICK",
"[link] Order Now -> CLICK",
"[button] Help Me Choose Solar -> CLICK",
"[button] Next -> CLICK"
]
},
{
"website": "tesla",
"id": "fdc94e3a-caa3-42b0-aa1b-b99f728f6292",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Schedule a demo drive for Model Y for Roy Adams with phone number 123-999-0000, email address RA@gmail.com and zip code 90001 in the United States.",
"action_reprs": [
"[link] Demo Drive -> CLICK",
"[button] Model Y -> CLICK",
"[textbox] Last Name -> TYPE: Adams",
"[textbox] First Name -> TYPE: Roy",
"[textbox] Phone Number -> TYPE: 123-999-0000",
"[textbox] Email Address -> TYPE: RA@gmail.com",
"[textbox] Zip Code -> TYPE: 90001",
"[button] Submit and Continue -> HOVER"
]
},
{
"website": "newegg",
"id": "17fffbee-e41b-46e4-ab75-675b263ca7b7",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "Find the cheapest power supply unit with at least 600W power output.",
"action_reprs": [
"[searchbox] Search Site -> TYPE: 600w power supply",
"[button] \uf002 -> CLICK",
"[generic] 600 W -> CLICK",
"[combobox] Featured Items \uf0d7 -> SELECT: Lowest Price",
"[img] Hercules DUAL FAN 600w-Max ATX Power Supply SATA, ... -> CLICK"
]
},
{
"website": "uniqlo",
"id": "08a998f9-82f7-48c8-b6ba-72a58d39b457",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Find all Uniqlo's located in Chicago, IL.",
"action_reprs": [
"[link] Store Locator -> CLICK",
"[searchbox] SEARCH BY KEYWORD -> CLICK",
"[searchbox] SEARCH BY KEYWORD -> TYPE: Chicago",
"[input] -> CLICK",
"[option] IL -> CLICK"
]
},
{
"website": "uniqlo",
"id": "099a9da4-c8db-4900-ada2-76600f3655a4",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Show me the list of baby products that are on sale and under 10 dollars.",
"action_reprs": [
"[link] BABY -> HOVER",
"[link] Sale -> CLICK",
"[heading] Price -> CLICK",
"[label] $0-$10 -> CLICK"
]
},
{
"website": "uniqlo",
"id": "122178b3-b5d4-41f0-be38-150ca0e2f5ed",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Find a black blazer for men with L size and add to wishlist.",
"action_reprs": [
"[svg] -> CLICK",
"[searchbox] Search by keyword -> TYPE: blazer",
"[span] blazer -> CLICK",
"[heading] Gender > Category -> CLICK",
"[input] -> CLICK",
"[option] MEN -> CLICK",
"[svg] -> CLICK",
"[heading] Color -> CLICK",
"[span] BLACK -> CLICK",
"[svg] -> CLICK",
"[path] -> CLICK",
"[button] L -> CLICK",
"[button] CLOSE -> CLICK"
]
},
{
"website": "soundcloud",
"id": "3e0d115f-9da7-4211-9d99-122912890b40",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Delete the history of what i heard recently.",
"action_reprs": [
"[link] Library -> CLICK",
"[link] History -> CLICK",
"[button] Clear all history -> CLICK",
"[button] Clear my history -> CLICK"
]
},
{
"website": "soundcloud",
"id": "48ca542f-5346-40b9-b586-9294a2f64519",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Like a game mix album.",
"action_reprs": [
"[searchbox] Search -> TYPE: game mix",
"[button] Search -> CLICK",
"[link] Albums -> CLICK",
"[button] Like -> CLICK"
]
},
{
"website": "gamestop",
"id": "91e18ec8-5eae-4b14-a49e-9ed7ee1ebb10",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Show me the list of playstation 5 games available for pre-orders.",
"action_reprs": [
"[button] Main Menu -> CLICK",
"[button] Video Games chevron_right -> CLICK",
"[button] PlayStation 5 -> CLICK",
"[link] Filter -> CLICK",
"[checkbox] Shop Pre-Orders Shop Pre-Orders -> CLICK",
"[button] Done -> CLICK"
]
},
{
"website": "gamestop",
"id": "9653dc0d-96d9-414f-a711-3af94bd7cf5b",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "sell playstation controller for cash credit on GameStop in 43240.",
"action_reprs": [
"[link] repeat Trade-In -> CLICK",
"[img] -> CLICK",
"[link] Sony DUALSHOCK 4 Wireless Controller for PlayStati... -> CLICK",
"[div] Find a Store -> CLICK",
"[link] FIND A STORE -> CLICK",
"[textbox] SEARCH BY CITY, STATE, OR ZIP CODE -> TYPE: 43240",
"[button] SEARCH -> CLICK",
"[button] Polaris Fashion Place Mall - GameStop -> CLICK"
]
},
{
"website": "gamestop",
"id": "981fdb06-2352-439f-a6d0-ccaa857c7a54",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find the trade-in options for PS4.",
"action_reprs": [
"[link] repeat Trade-In -> CLICK",
"[p] Consoles -> CLICK",
"[link] Filter -> CLICK",
"[generic] Refine by Category: PlayStation 4 -> CLICK",
"[button] Done -> CLICK"
]
},
{
"website": "tvguide",
"id": "9cc81f50-465c-4d77-8fd7-d81fe1ffde84",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Find the channel number for the local CBS in Spokane Washington in 99201.",
"action_reprs": [
"[link] Live TV -> CLICK",
"[button] Broadcast TV Spokane (3) -> CLICK",
"[textbox] Search -> TYPE: 99201",
"[button] Antenna -> CLICK",
"[button] Broadcast TV Spokane (3) -> CLICK",
"[button] Apply -> CLICK",
"[button] Skip -> CLICK",
"[div] CH 2.1 -> CLICK"
]
},
{
"website": "airbnb",
"id": "181e8206-2d04-47ea-bcaf-f701b8c5525a",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Search for Castles in Europe for a week next month and price below $1000 per night.",
"action_reprs": [
"[button] Location Anywhere -> CLICK",
"[div] -> CLICK",
"[button] 1, Saturday, April 2023. Available. Select as chec... -> CLICK",
"[button] 8, Saturday, April 2023. Available. Select as chec... -> CLICK",
"[span] -> CLICK",
"[span] Castles -> CLICK",
"[button] Filters -> CLICK",
"[textbox] max price $ -> TYPE: 1000",
"[link] Show 673 stays -> CLICK"
]
},
{
"website": "rottentomatoes",
"id": "5fb9730d-f489-4cb7-a220-d406794cef29",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "List all George Clooney movies and sort them by box office revenue",
"action_reprs": [
"[textbox] Search -> TYPE: George Clooney",
"[p] George Clooney -> CLICK",
"[button] BOX OFFICE -> CLICK"
]
},
{
"website": "seatgeek",
"id": "ac59be41-36c3-44c5-8e1f-ffb9461ba980",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Search for all Alternative Concerts taking place in New York City.",
"action_reprs": [
"[button] Change Location -> CLICK",
"[searchbox] Search by city... -> TYPE: New York",
"[option] New York, NY -> CLICK",
"[img] Concerts -> CLICK",
"[img] Alternative -> CLICK"
]
},
{
"website": "seatgeek",
"id": "b20d38a9-8c0f-4ed5-becc-f0f54fb90798",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Show me the page with information about the NBA Finals schedule.",
"action_reprs": [
"[div] Sports -> HOVER",
"[link] NBA -> HOVER",
"[link] NBA Finals -> CLICK"
]
},
{
"website": "seatgeek",
"id": "bb3e2b61-c14c-4a15-8de4-7c12256d52c7",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Search for concerts taking place in Los Angeles, CA in the next month.",
"action_reprs": [
"[button] Change Location -> CLICK",
"[searchbox] Search by city... -> TYPE: Los Angeles",
"[option] Los Angeles, CA -> CLICK",
"[span] Filter by -> CLICK",
"[div] 16 -> CLICK",
"[div] 16 -> CLICK",
"[button] Apply -> CLICK",
"[img] Concerts -> CLICK"
]
},
{
"website": "new.mta.info",
"id": "ab989f1e-bacb-4c37-ab81-c8f24ee3284b",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "View the special timetable for Far Rockaway Branch of the Long Island Railroad.",
"action_reprs": [
"[link] Schedules -> CLICK",
"[heading] Long Island Rail Road & Metro-North Railroad -> CLICK",
"[div] Long Island Rail Road schedules -> CLICK",
"[link] Far Rockaway Branch -> CLICK"
]
},
{
"website": "new.mta.info",
"id": "d7c3103a-c195-4503-ab20-ecae4d4ce419",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find the motorcycle toll fee for the Queens midtown tunnel.",
"action_reprs": [
"[link] Fares & Tolls -> CLICK",
"[div] Bridges and Tunnels tolls -> CLICK",
"[span] Toll Rates -> CLICK",
"[span] Motorcycles -> CLICK",
"[heading] Bronx-Whitestone, Throgs Neck,\u00a0Robert F. Kennedy, ... -> CLICK"
]
},
{
"website": "new.mta.info",
"id": "db203a3a-8e62-41aa-ac05-717a8c11508d",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Plan a trip from Brooklyn, NY to Staten Island, NY on March 25th mainly using bus and subway terminal. The trip should arive at 9:45 AM.",
"action_reprs": [
"[searchbox] From -> TYPE: brooklyn",
"[listitem] Brooklyn, NY, USA -> CLICK",
"[searchbox] To -> TYPE: staten island",
"[listitem] Staten Island, NY, USA -> CLICK",
"[button] Leave now Change Time -> CLICK",
"[textbox] Select date (format month/day/year) -> CLICK",
"[button] 03/18/2023 -> CLICK",
"[link] 25, Saturday March 2023 -> CLICK",
"[radio] Arrive by -> CLICK",
"[select] 1 -> SELECT: 9",
"[select] 00 -> SELECT: 45",
"[select] AM -> SELECT: AM",
"[button] 3/25/2023 -> CLICK",
"[link] 25, Saturday March 2023 -> CLICK",
"[button] Open Travel Preferences modal. -> CLICK",
"[label] Rail -> CLICK",
"[label] Express Bus -> CLICK",
"[button] Done button - Press enter key to submit travel pre... -> CLICK",
"[link] Plan my Trip - Press enter key to submit the form ... -> CLICK"
]
},
{
"website": "rei",
"id": "af6655c8-0047-4c93-8da2-aeb04ff06b17",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Browse climbing courses within 50 miles of 90028.",
"action_reprs": [
"[link] Classes & Events -> CLICK",
"[combobox] Activity -> SELECT: Climbing",
"[textbox] Location -> TYPE: 90028",
"[combobox] Distance -> SELECT: Within 50 miles",
"[button] Search -> CLICK"
]
},
{
"website": "redbox",
"id": "12324b80-88bd-4d48-962c-ae80203e5058",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Find $1 movie night film and rent blockers",
"action_reprs": [
"[link] Navigate to deals -> CLICK",
"[link] Navigate to 1-Night Kiosk Rentals See More -> CLICK",
"[img] Blockers, MOVIE on , , Comedy, Romance, Special In... -> CLICK",
"[button] select to rent on demand movie -> CLICK"
]
},
{
"website": "redbox",
"id": "2879afa9-05f9-4d97-bbfe-f95f5d665174",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Play the Wakanda Forever trailer",
"action_reprs": [
"[link] Navigate to on-demand -> HOVER",
"[link] select to navigate to Genres -> CLICK",
"[img] Black Panther: Wakanda Forever, MOVIE on , , , Act... -> CLICK",
"[path] -> CLICK"
]
},
{
"website": "eventbrite",
"id": "2a45ede7-6449-40b2-b032-149ddbe205a9",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Contact Yeah You Right Events who are the organisers of the Food Fight 2023 event being held in New Orleans on May 25th to ask a question about the event",
"action_reprs": [
"[combobox] autocomplete -> TYPE: New Orleans",
"[div] LA, USA -> CLICK",
"[button] Food & Drink -> CLICK",
"[div] -> CLICK",
"[button] Contact -> CLICK",
"[button] Contact the organizer -> CLICK",
"[listbox] Contact reason * (required) -> SELECT: Question about the event"
]
},
{
"website": "eventbrite",
"id": "51221157-cb79-407e-95c8-b2c730e95e01",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Find a music party in Ohio and follow its organizer",
"action_reprs": [
"[div] Search for events -> CLICK",
"[textbox] Search events -> TYPE: music",
"[combobox] autocomplete -> TYPE: ohio",
"[div] Ohio -> CLICK",
"[generic] Run Search -> CLICK",
"[label] -> CLICK",
"[div] RANG BARSEY- HOLI MUSIC FESTIVAL, CINCINNATI -> CLICK",
"[button] Follow -> CLICK"
]
},
{
"website": "nyc",
"id": "86897828-35e8-4002-a98a-4e1dd26c6edb",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "check the lowest price ticket for All star stand up comedy event happen 6pm on the 25th March 2023.",
"action_reprs": [
"[link] concerts. -> CLICK",
"[textbox] Search by Name -> TYPE: all star stand up comedy",
"[p] All Star Stand Up Comedy -> CLICK",
"[link] View Tickets -> CLICK",
"[span] Filters -> CLICK",
"[listbox] Sort by Price - Low to High -> CLICK",
"[button] Done -> CLICK"
]
},
{
"website": "nyc",
"id": "8aedabbf-a7b4-4da7-8eaf-9e159a3ec99b",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "review the dinner menu of La Bergamote restaurant in Hell's Kitchen.",
"action_reprs": [
"[link] restaurants. -> CLICK",
"[i] -> CLICK",
"[textbox] Search by restaurant name, cuisine, or anything be... -> TYPE: La Bergamote",
"[button] Search -> CLICK",
"[heading] La Bergamote \u2014 Midtown -> CLICK",
"[link] Reservation -> CLICK",
"[button] Menu -> CLICK",
"[tab] Dinner Menu -> CLICK",
"[button] View full menu -> CLICK"
]
},
{
"website": "nyc",
"id": "a531a379-7770-4b72-a8cc-ee19419536cb",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "search for art galleries in midtown",
"action_reprs": [
"[link] attractions. -> CLICK",
"[li] Neighborhood -> CLICK",
"[link] Midtown -> CLICK",
"[link] Art Galleries (5) -> CLICK"
]
},
{
"website": "underarmour",
"id": "ebae9339-93bf-4f5a-9396-ce30bcec7b49",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Find the price of Boys' INFANT UA SURGE 3 RUNNING SHOES. black color and 9K size",
"action_reprs": [
"[menuitem] Kids -> CLICK",
"[div] Product Category -> CLICK",
"[link] Shoes -> CLICK",
"[div] Color -> CLICK",
"[link] Refine by color: Black -> CLICK",
"[div] Size -> CLICK",
"[link] 9K -> CLICK",
"[img] Boys' Infant UA Surge 3 AC Running Shoes -> CLICK"
]
},
{
"website": "jetblue",
"id": "b7003092-3e6e-4fac-9867-083cac064f89",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find JetBlue career openings in New York",
"action_reprs": [
"[link] CareersExternal Link should open in a new window o... -> CLICK",
"[textbox] Search by Location -> CLICK",
"[textbox] Search by Location -> TYPE: New York",
"[button] Search Jobs -> CLICK"
]
},
{
"website": "jetblue",
"id": "bdc1f69a-da73-4e51-9dd8-83494d4983c2",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find check-in flight for John Smith having ticket no. 123456780",
"action_reprs": [
"[link] Check In -> CLICK",
"[textbox] first name maxlimit is 30 -> TYPE: John",
"[textbox] last name maxlimit is 30 -> TYPE: Smith",
"[select] Confirmation Code -> SELECT: Ticket Number",
"[textbox] ticket number maxlimit is 13 -> TYPE: 123456780",
"[button] FIND FLIGHTS -> CLICK"
]
},
{
"website": "jetblue",
"id": "c5d1ecbe-f7a6-4d27-9e03-08dcfdcb524f",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Book a flight + cruise for two flying from Atlanta in October for vacation starting on October 8 for 6 nights with Miami as the departure port, choose the cheapest flight, hotel, and room in the cruise for booking.",
"action_reprs": [
"[span] Flights + Cruise -> CLICK",
"[button] Search flights + cruise External Link should open ... -> CLICK",
"[combobox] Departing from -> TYPE: ATLANTA",
"[span] Atlanta, GA (ATL) -> CLICK",
"[span] Jun 2023 -> CLICK",
"[option] Oct 2023 -> CLICK",
"[button] Search flights + cruise -> CLICK",
"[label] October 08, 2023 -> CLICK",
"[span] Nights -> CLICK",
"[label] Miami -> CLICK",
"[button] View details -> CLICK",
"[link] Select package -> CLICK",
"[span] Checkout -> CLICK"
]
},
{
"website": "newegg",
"id": "2fc63250-ac9a-4cd4-a29d-6460f0652fa3",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "Find a wireless keyboard and mouse combo under $100.",
"action_reprs": [
"[searchbox] Search Site -> TYPE: wireless keyboard mouse",
"[button] \uf002 -> CLICK",
"[textbox] price to -> TYPE: 100",
"[button] APPLY -> CLICK",
"[link] Logitech MK270 Wireless Keyboard And Mouse Combo F... -> CLICK"
]
},
{
"website": "agoda",
"id": "1b17b79c-589f-45eb-b55d-c977d1b9708e",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Find the cheapest motel for 2 adults in Seattle from 11 May to 18 May",
"action_reprs": [
"[combobox] Enter a destination or property -> TYPE: seattle",
"[option] Seattle (WA), United States (City) -> CLICK",
"[button] Next Month -> CLICK",
"[span] 11 -> CLICK",
"[span] 18 -> CLICK",
"[span] SEARCH -> CLICK",
"[span] SEARCH -> CLICK",
"[checkbox] Motel -> CLICK",
"[tab] Lowest price first -> CLICK"
]
},
{
"website": "agoda",
"id": "1fefdb27-882b-481b-97e2-720f4d2338a3",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Look for activities in Phuket, Thailand.",
"action_reprs": [
"[path] -> CLICK",
"[combobox] Search by city or activity -> TYPE: Phuket",
"[generic] Thailand -> CLICK",
"[button] SEARCH -> CLICK"
]
},
{
"website": "soundcloud",
"id": "58badcfc-343a-47c1-8aec-f609925eb4ed",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Find a Ricky Kej track to listen and share which has been added in the last year and is between 2 to 10 minutes.",
"action_reprs": [
"[searchbox] Search -> TYPE: Ricky Kej",
"[link] Search for \u201cRicky Kej\u201d -> CLICK",
"[link] Tracks -> CLICK",
"[link] Added any time -> CLICK",
"[link] Past year -> CLICK",
"[link] Any length -> CLICK",
"[link] 2-10 min -> CLICK",
"[link] To listen to -> CLICK",
"[link] To share -> CLICK"
]
},
{
"website": "united",
"id": "9ea9ac0d-8c31-49bc-aa3d-e85b80580409",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find the flight schedule between London and New York for April 7 and check the upgrade details of the noon flight.",
"action_reprs": [
"[heading] Flight status -> CLICK",
"[combobox] Enter your departing city, airport name, or airpor... -> TYPE: london",
"[span] London -> CLICK",
"[combobox] Enter your destination city, airport name, or airp... -> TYPE: new york",
"[span] New York -> CLICK",
"[generic] Apr 6, 2023 -> CLICK",
"[option] Apr 7, 2023 -> CLICK",
"[button] Search -> CLICK",
"[link] View details -> CLICK",
"[tab] Upgrades -> CLICK"
]
},
{
"website": "espn",
"id": "e6643cfb-567e-4e11-8cab-f85483573539",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Follow one of the team leaders of one of the NHL teams from the Atlantic Division",
"action_reprs": [
"[link] ESPN NHL Home Page -> HOVER",
"[link] Teams -> CLICK",
"[heading] Boston Bruins -> CLICK",
"[link] Full Team Statistics -> CLICK",
"[heading] David Pastrnak RW -> CLICK",
"[button] FOLLOW -> CLICK"
]
},
{
"website": "espn",
"id": "e7e1616e-dd5f-4eb4-a7f1-b757c7880877",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Look up the scores for the previous day's NBA games",
"action_reprs": [
"[link] NBA -> HOVER",
"[link] Scores -> CLICK",
"[span] Mon -> CLICK"
]
},
{
"website": "mbta",
"id": "cc174cb2-520d-49c3-93da-f93a1c485c03",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Calculate the fare options to go from the south station to the north station",
"action_reprs": [
"[button] Fares \uf0d7 -> CLICK",
"[link] Fares Overview -> CLICK",
"[combobox] Enter a location -> TYPE: south station",
"[link] T red line silver line commuter rail Zone 1A Sout... -> CLICK",
"[combobox] Enter a location -> TYPE: north station",
"[link] T orange line green line D green line E commuter ... -> CLICK",
"[button] Calculate my fare -> CLICK"
]
},
{
"website": "travelzoo",
"id": "c95ac388-3fea-457d-bb5d-fede3785c6f6",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Show me hotels in New York city to stay in during spring",
"action_reprs": [
"[textbox] Where? -> TYPE: New York City",
"[div] New York City, NY -> CLICK",
"[textbox] When? -> CLICK",
"[li] Spring -> CLICK",
"[button] SEARCH DEALS -> CLICK"
]
},
{
"website": "travelzoo",
"id": "d9c160e7-b179-4d42-8570-e6f3f85aa412",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Find the highest-rated adults-only romantic beach vacation deals and book the cheapest one.",
"action_reprs": [
"[link] Vacations -> CLICK",
"[link] Beach Vacation Deals 95 DEALS -> CLICK",
"[button] Filter -> CLICK",
"[button] Highest Rated -> CLICK",
"[button] Adults-Only -> CLICK",
"[button] Romantic -> CLICK",
"[button] DONE -> CLICK",
"[generic] Go to Aspire Down Under site -> CLICK"
]
},
{
"website": "amctheatres",
"id": "29f47ddb-3d25-4cfb-b1d6-d3987e998a13",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Check the movie \"65\" that is digital at the AMC Grove City 14 showing at 7:30 pm on Tuesday, March 28, 2023 and buy four tickets for seats J10 through J7",
"action_reprs": [
"[select] AMC Grove City 14 -> SELECT: AMC Grove City 14",
"[select] All Movies -> SELECT: 65",
"[select] Sun, Mar 26 -> SELECT: Tue, Mar 28",
"[link] 7:30pm -> CLICK",
"[text] J10 -> CLICK",
"[text] J9 -> CLICK",
"[text] J8 -> CLICK",
"[text] J7 -> CLICK",
"[svg] -> CLICK"
]
},
{
"website": "tvguide",
"id": "1b82bda7-a360-49c4-b54a-adaa1ae388cb",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Find the birth place of Ali Wong.",
"action_reprs": [
"[textbox] Search TV Shows and Movies... -> TYPE: Ali Wong",
"[div] Ali Wong: Hard Knock Wife -> CLICK",
"[a] -> CLICK"
]
},
{
"website": "tvguide",
"id": "28d54466-de85-45e6-9649-2575d38adfd4",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Browse documentaries streaming on Netflix.",
"action_reprs": [
"[link] What to Watch on Netflix -> CLICK",
"[button] Filter -> CLICK",
"[button] Documentary -> CLICK",
"[button] View Results -> CLICK"
]
},
{
"website": "ryanair",
"id": "112dba49-3ea4-49ce-9a7b-b47d82d3f81b",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find top-rated outdoor activity events in Spain, that is happening on May 1 and book the tickets for two adults in morning group with an English guide.",
"action_reprs": [
"[div] Events & Activities -> CLICK",
"[input] -> CLICK",
"[button] Spain -> CLICK",
"[button] All cities -> CLICK",
"[button] Go! -> CLICK",
"[input] -> CLICK",
"[div] All dates -> CLICK",
"[span] -> CLICK",
"[span] 1 -> CLICK",
"[div] Sort by -> CLICK",
"[div] Top rated -> CLICK",
"[link] Get tickets -> CLICK",
"[p] Number of Travellers -> CLICK",
"[img] -> CLICK",
"[button] Check availability -> CLICK",
"[img] -> CLICK",
"[li] English - Guide -> CLICK",
"[button] Select and Checkout -> CLICK"
]
},
{
"website": "ryanair",
"id": "1202e28a-361d-4704-979a-526c599b4859",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find a fully electric car pickup at Athens Airport (ATH) Sat, Apr 1, 2023 and return to the same palce at Mon, Apr 3, 2023.",
"action_reprs": [
"[div] Car Hire -> CLICK",
"[textbox] I need a car in -> TYPE: Athens",
"[button] Athens Airport (ATH) Athens, Greece -> CLICK",
"[div] Apr -> CLICK",
"[generic] 1 -> CLICK",
"[generic] 3 -> CLICK",
"[button] Let's go -> CLICK",
"[span] -> CLICK"
]
},
{
"website": "underarmour",
"id": "35cf31d3-c88d-45fe-9959-4cf1de72bc7d",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Browse for trending women sports bras and add 3 trending black bras to Wishlist.",
"action_reprs": [
"[menuitem] Women -> CLICK",
"[link] Sports Bras -> CLICK",
"[div] Color -> CLICK",
"[link] Refine by color: Black -> CLICK",
"[button] Add to Wish List -> CLICK",
"[button] Add to Wish List -> CLICK",
"[button] Add to Wish List -> CLICK"
]
},
{
"website": "spothero",
"id": "c9f65ae8-bd67-4a83-82d7-d42587e34e98",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Sell my parking space in Houston. Name: James Smith, Email: buckeye.foobar@gmail.com, phone: 8888888888. Address: 123rd st.",
"action_reprs": [
"[link] Rent My Parking Space -> CLICK",
"[textbox] First Name * -> TYPE: James",
"[textbox] Last Name * -> TYPE: Smith",
"[textbox] Email * -> TYPE: buckeye.foobar@gmail.com",
"[textbox] Phone * -> TYPE: 8888888888",
"[combobox] Market: * -> SELECT: Chicago",
"[textbox] Spot Address: * -> TYPE: 123rd st",
"[button] Submit -> HOVER"
]
},
{
"website": "spothero",
"id": "e4f8a347-b288-4a00-9e6b-89cbccda42d2",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Search for a parking near any airport in california starting april 20 and ending april 23",
"action_reprs": [
"[link] View All Airports -> CLICK",
"[link] Reserve Now -> CLICK",
"[textbox] Select Start Date -> CLICK",
"[gridcell] Thu Apr 20 2023 -> CLICK",
"[textbox] Select End Date -> CLICK",
"[gridcell] Sun Apr 23 2023 -> CLICK",
"[link] Search -> CLICK"
]
},
{
"website": "expedia",
"id": "97e3f951-891d-4626-8dbb-ab6e39261d05",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Find first class flight for May 27 from JFK, New York to Heathrow, London for 2 adults, one 4 year old child and one infant under 1 year old who will sit on a lap.",
"action_reprs": [
"[tab] Flights -> CLICK",
"[tab] One-way -> CLICK",
"[button] 1 traveler -> CLICK",
"[img] Increase adults -> CLICK",
"[button] 2 travelers -> CLICK",
"[img] Increase children -> CLICK",
"[img] Increase infants -> CLICK",
"[combobox] Child 1 age -> SELECT: 4",
"[combobox] Infant 1 age -> SELECT: Under 1",
"[button] Done -> CLICK",
"[button] Preferred flight class Economy -> CLICK",
"[menuitem] First class -> CLICK",
"[button] Departing April 5, 2023 -> CLICK",
"[button] May 27, 2023 -> CLICK",
"[button] Done : (Save changes and close the date picker.) -> CLICK",
"[button] Leaving from -> CLICK",
"[textbox] Leaving from -> TYPE: jfk",
"[button] New York (JFK - John F. Kennedy Intl.) New York, U... -> CLICK",
"[button] Going to -> CLICK",
"[textbox] Going to -> TYPE: heathrow",
"[button] London (LHR - Heathrow) United Kingdom -> CLICK",
"[button] Search -> CLICK"
]
},
{
"website": "bookdepository",
"id": "dd057bda-33ea-40b8-9865-771242e22f40",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Browse fiction audio books sorted by lowest price.",
"action_reprs": [
"[link] Shop by category\u2228 -> HOVER",
"[link] Audio Books -> CLICK",
"[link] Fiction -> CLICK",
"[select] Most popular -> SELECT: Price, low to high"
]
},
{
"website": "bookdepository",
"id": "f296f6a6-dbb7-47dd-bd6f-4ac2336a7d28",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Check the French best sellers under $40 available in digital that are currently in stock.",
"action_reprs": [
"[link] Bestsellers -> CLICK",
"[select] All -> SELECT: US$20 to US$40",
"[select] All -> SELECT: In stock (53476)",
"[select] All -> SELECT: Digital",
"[select] All -> SELECT: French (299)",
"[button] Refine results -> CLICK"
]
},
{
"website": "booking",
"id": "14b72eb6-48c6-4408-9044-94c3003dccfc",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Book a flight for two adults from Shanghai to Seoul on May 10, and return on May 12 also book a hotel with it, with maximum bundled savings and if top hotel not available book the next one.",
"action_reprs": [
"[span] Flight + Hotel -> CLICK",
"[textbox] Where from? -> TYPE: SHANGHAI",
"[div] Shanghai, China -> CLICK",
"[textbox] Where to? -> TYPE: SEOUL",
"[div] Seoul, Republic Of Korea -> CLICK",
"[svg] -> CLICK",
"[path] -> CLICK",
"[checkbox] 10 May 2023 -> CLICK",
"[checkbox] 12 May 2023 -> CLICK",
"[button] Search -> CLICK",
"[button] Choose your room -> CLICK",
"[link] Choose Another Hotel -> CLICK",
"[button] Choose your room -> CLICK",
"[button] Book Double Bed - Standard Room -> CLICK",
"[svg] -> CLICK",
"[svg] -> CLICK",
"[button] Choose -> CLICK"
]
},
{
"website": "booking",
"id": "3d76a0fc-7ba9-4a74-ac52-db0cea359553",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Find the lowest-priced round trip flight with hotel on May 2 from Kathmandu, Nepal KTM to Shanghai, China PVG and return on May 5. Book a double room and check out with the default flights.",
"action_reprs": [
"[link] Flight + Hotel -> CLICK",
"[textbox] Where from? -> TYPE: KATHMANDU",
"[div] Tribhuvan Intl Airport (KTM), Nepal -> CLICK",
"[textbox] Where to? -> TYPE: SHANGHAI",
"[div] Pudong Intl Airport (PVG), China -> CLICK",
"[span] Sat 8 Apr - Sat 15 Apr -> CLICK",
"[checkbox] 2 May 2023 -> CLICK",
"[checkbox] 5 May 2023 -> CLICK",
"[button] Search -> CLICK",
"[button] Recommended -> CLICK",
"[div] Lowest Price -> CLICK",
"[svg] -> CLICK",
"[button] Choose your room -> CLICK",
"[button] Book Business Double Room A -> CLICK",
"[svg] -> CLICK",
"[svg] -> CLICK",
"[button] Choose -> CLICK",
"[button] Continue to checkout -> CLICK"
]
},
{
"website": "foxsports",
"id": "85bd1881-6efd-458d-97c9-ae507ecba1ca",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Find the odds for upcoming NHL matches.",
"action_reprs": [
"[span] Odds -> CLICK",
"[heading] NHL -> CLICK",
"[heading] GAMES -> CLICK"
]
},
{
"website": "foxsports",
"id": "86ea50f5-1310-456e-97bf-799d8eb1896b",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Open the NFL Passing yards players stats.",
"action_reprs": [
"[link] National Football League NFL -> CLICK",
"[button] Open More Dropdown -> CLICK",
"[heading] STATS -> CLICK",
"[heading] PASSING YARDS -> CLICK"
]
},
{
"website": "foxsports",
"id": "8ab30c9e-f768-46e8-8174-83651d361b9e",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Show me the scores of today's NBA games.",
"action_reprs": [
"[span] Scores -> CLICK",
"[heading] NBA -> CLICK",
"[button] Today -> CLICK"
]
},
{
"website": "cvs",
"id": "95499427-980a-4115-b1aa-6b252b4fb2c3",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Browse cough medicine that is rated 4 stars and above and is $15-$20.",
"action_reprs": [
"[combobox] Search products and services -> TYPE: cough medicine",
"[button] Search for cough medicine -> CLICK",
"[div] -> CLICK",
"[div] -> CLICK"
]
},
{
"website": "boardgamegeek",
"id": "020bc054-a829-4af5-8f0a-6efce012c7ac",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Buy the number 4 ranked board game on the geekmarket.",
"action_reprs": [
"[button] Browse -> CLICK",
"[link] All Boardgames -> CLICK",
"[link] Ark Nova -> CLICK",
"[span] Ark Nova (English edition, third printing) -> CLICK",
"[link] \uf0e0 Message -> CLICK"
]
},
{
"website": "boardgamegeek",
"id": "360eeaa8-0077-42f4-8200-1e3cf6414cda",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Send a message to Joe Bloggs who has the username 'boredcelt'.",
"action_reprs": [
"[button] Community -> CLICK",
"[link] Find Users -> CLICK",
"[link] User Search -> CLICK",
"[textbox] Enter First name, last name, and/or username: -> TYPE: Joe Bloggs",
"[button] Go -> CLICK",
"[img] msg -> CLICK"
]
},
{
"website": "boardgamegeek",
"id": "54112d86-1d85-4abf-9e12-86f526d314c2",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "What are the BGG rules for Game Submissions?",
"action_reprs": [
"[button] Help -> CLICK",
"[link] Guide to BGG -> CLICK",
"[link] Submit game listings -> CLICK"
]
},
{
"website": "boardgamegeek",
"id": "562d8516-e1fa-464b-9bb1-542fe818c721",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Buy the cheapest copy of King of Tokyo on GeekMarket that ships to Canada.",
"action_reprs": [
"[button] Shopping -> CLICK",
"[link] GeekMarket -> CLICK",
"[combobox] Search Board Games... -> TYPE: king of tokyo",
"[link] King of Tokyo -> CLICK",
"[button] Sort: Recently Added -> CLICK",
"[link] Price (lowest first) -> CLICK",
"[button] Add Filter -> CLICK",
"[link] Ship Location -> CLICK",
"[button] Ship Location: Any -> CLICK",
"[link] Canada -> CLICK",
"[link] King of Tokyo -> CLICK",
"[button] \uf0e0 Message -> CLICK"
]
},
{
"website": "sixflags",
"id": "8f4a020d-ac81-4d20-ae3a-02808faaba4e",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Buy a birthday party package for a group of 10 at Arizona park with my address details. Group name is Neo, group leader's name is Thomas Anderson, birthday is May 5th, 1995. The phone number is2526545258. The email address is thomas.neo@gmail.com and address is po box 2846, Texas city in the state of Texas.",
"action_reprs": [
"[button] Browse the Parks Below -> CLICK",
"[span] Hurricane Harbor Phoenix -> CLICK",
"[button] Go! -> CLICK",
"[link] Tickets & Passes \uf078 -> CLICK",
"[link] Birthdays -> CLICK",
"[button] Buy Now\ue903 -> CLICK",
"[button] Next -> CLICK",
"[input] -> TYPE: Neo",
"[input] -> TYPE: Thomas",
"[input] -> TYPE: 05/05/1995",
"[input] -> TYPE: Texas city",
"[input] -> TYPE: 252-654-5258",
"[input] -> TYPE: thomas.neo@gmail.com",
"[input] -> TYPE: Anderson",
"[input] -> TYPE: po box 2846",
"[input] -> TYPE: Texas",
"[button] Complete -> CLICK",
"[button] Continue Shopping -> CLICK",
"[button] Next -> CLICK"
]
},
{
"website": "agoda",
"id": "04d45cb8-136b-419a-a324-dfbc5e93b7a2",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Show activities in Miami with lowest price and minimum 4 star rated.",
"action_reprs": [
"[path] -> CLICK",
"[combobox] Search by city or activity -> TYPE: Miami",
"[generic] United States -> CLICK",
"[button] SEARCH -> CLICK",
"[span] Sort and filter -> CLICK",
"[div] -> CLICK",
"[checkbox] 4 stars rating -> CLICK",
"[radio] Lowest price first -> CLICK",
"[button] Filter -> CLICK"
]
},
{
"website": "agoda",
"id": "1684f224-47d5-45ed-9a26-821b98b851cd",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Look for the highest reviewed for a 4-adults stay in Hollywood, USA, on April 19 to 23 with an option for free cancellation with a price range between 150 to 200 dollars.",
"action_reprs": [
"[combobox] Enter a destination or property -> TYPE: HOLLYWOOD",
"[span] Hollywood -> CLICK",
"[button] 19 -> CLICK",
"[button] 23 -> CLICK",
"[img] Add -> CLICK",
"[img] Add -> CLICK",
"[i] -> CLICK",
"[span] SEARCH -> CLICK",
"[textbox] Minimum price filter -> TYPE: 150",
"[textbox] Maximum price filter -> TYPE: 200",
"[checkbox] list-filter-item-label-4 -> CLICK",
"[svg] -> CLICK"
]
},
{
"website": "travelzoo",
"id": "50c13c64-4c9b-4f55-84f6-65ae443848a2",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Find highest rated romantic summer vacations in Spain",
"action_reprs": [
"[textbox] What type of deals? -> CLICK",
"[div] Vacations -> CLICK",
"[textbox] Where? -> CLICK",
"[textbox] Where? -> TYPE: Spain",
"[div] Spain -> CLICK",
"[textbox] When? -> CLICK",
"[li] Summer -> CLICK",
"[button] SEARCH DEALS -> CLICK",
"[button] Filter -> CLICK",
"[button] Highest Rated -> CLICK",
"[button] Romantic -> CLICK",
"[button] DONE -> CLICK"
]
},
{
"website": "travelzoo",
"id": "604c4377-e24c-4900-a72f-346d8999d443",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Select a deal which is highly rated in Fiji location.",
"action_reprs": [
"[textbox] Where? -> TYPE: Fiji",
"[div] Fiji -> CLICK",
"[button] Filter -> CLICK",
"[button] Highest Rated -> CLICK",
"[button] DONE -> CLICK",
"[heading] $2259 & up 6-Nt. Sydney & Fiji Island Trip w/Air &... -> CLICK"
]
},
{
"website": "target",
"id": "274571ea-fc2f-4353-86ba-00ecb112d6d2",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Find multi-colored fillable eggs for easter eggs made from polypropylene priced between 5 to 10 dollars for pick-up from Barboursville, zip 25504.",
"action_reprs": [
"[span] Charleston -> CLICK",
"[textbox] zip or city, state -> TYPE: 25504",
"[button] Look up -> CLICK",
"[heading] Barboursville -> CLICK",
"[link] More info about Barboursville store -> CLICK",
"[button] make it my store -> CLICK",
"[path] -> CLICK",
"[span] Easter -> CLICK",
"[span] Easter Eggs -> CLICK",
"[button] Type -> CLICK",
"[div] -> CLICK",
"[button] close -> CLICK",
"[button] Price -> CLICK",
"[textbox] $ -> TYPE: 5",
"[textbox] $$$ -> TYPE: 10",
"[button] close -> CLICK",
"[button] Color -> CLICK",
"[div] -> CLICK",
"[button] close -> CLICK",
"[button] Material -> CLICK",
"[div] -> CLICK",
"[button] close -> CLICK",
"[heading] Pickup -> CLICK",
"[button] Pick up Plastic Eggs in Egg Nesting Easter Eggs Mi... -> CLICK",
"[button] View cart & check out -> CLICK"
]
},
{
"website": "amazon",
"id": "e62bcf45-0be3-4195-b234-37755d6d715e",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Find a book by Sam Harris that has a rating of at least 4 stars and is available in paperback format.",
"action_reprs": [
"[textbox] Search Amazon -> TYPE: Sam Harris",
"[button] sam harris -> CLICK",
"[region] 4 Stars & Up -> CLICK",
"[link] Paperback -> CLICK",
"[heading] Waking Up: A Guide to Spirituality Without Religio... -> CLICK"
]
},
{
"website": "amazon",
"id": "f57e6c0a-8f8b-4756-9f1d-1bdea7a0af5c",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Add a pack of toilet paper and a bottle of laundry detergent to your Amazon cart with the lowest total price.",
"action_reprs": [
"[textbox] Search Amazon -> TYPE: toilet paper",
"[button] Go -> CLICK",
"[span] Featured -> CLICK",
"[option] Price: Low to High -> CLICK",
"[button] Add to Cart -> CLICK",
"[textbox] Search Amazon -> TYPE: laundry detergent",
"[button] Go -> CLICK",
"[span] Featured -> CLICK",
"[option] Price: Low to High -> CLICK",
"[button] Add to Cart -> CLICK"
]
},
{
"website": "underarmour",
"id": "440273fa-f1b0-41e8-be75-90732ad5170d",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Find the Mens size guide for bottoms",
"action_reprs": [
"[link] Size Guide -> CLICK",
"[link] Men -> CLICK",
"[link] Bottoms -> CLICK"
]
},
{
"website": "aa",
"id": "8888ebb8-c2b3-4173-9718-51d752b9e5ab",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find the lowest fare for JFK, NY to Heathrow, London and nearby airports for 1 adult on April 22, one way",
"action_reprs": [
"[button] PLAN TRAVEL -> CLICK",
"[link] Flights -> CLICK",
"[link] Search flights one way -> CLICK",
"[textbox] From , required. -> CLICK",
"[textbox] From , required. -> TYPE: JFK",
"[a] JFK - New York John F Kennedy Intl, NY -> CLICK",
"[span] -> CLICK",
"[textbox] To , required. -> CLICK",
"[textbox] To , required. -> TYPE: Heathrow",
"[a] LHR - London Heathrow, United Kingdom -> CLICK",
"[textbox] Depart , required. -> CLICK",
"[textbox] Depart , required. -> TYPE: 04/22/2023",
"[combobox] Number of passengers -> SELECT: 1",
"[combobox] Passenger 1 -> SELECT: Adult (16-64)",
"[combobox] Search by -> SELECT: Lowest fare",
"[button] Search -> CLICK"
]
},
{
"website": "aa",
"id": "895f32c1-7d6f-4474-b5b1-50daf5cb2a40",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find jobs available in Texas for American Airlines.",
"action_reprs": [
"[link] We're hiring! Join our team , Opens another site i... -> CLICK",
"[link] Search open jobs -> CLICK",
"[input] -> TYPE: TX",
"[button] Filter -> CLICK"
]
},
{
"website": "aa",
"id": "8b130a70-f03a-4f86-8f2a-44f1b44f3655",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Check my trip for Smith and booking number X899987799.",
"action_reprs": [
"[link] Manage trips / Check-in -> CLICK",
"[textbox] Passenger last name , required. -> TYPE: Smith",
"[textbox] Confirmation / Record locator , required. -> TYPE: X899987799",
"[button] Find your trip -> HOVER"
]
},
{
"website": "aa",
"id": "8b39c9ac-a965-4902-a7d9-ec7fb36ca096",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Check the status of a flight between San Antonio, Texas, and Bellingham, Washington on April 8.",
"action_reprs": [
"[link] Flight status -> CLICK",
"[textbox] From , required. -> TYPE: san antonio",
"[a] SAT - San Antonio International, TX -> CLICK",
"[textbox] To , required. -> TYPE: washington",
"[a] WAS - Washington, DC -> CLICK",
"[button] Search -> CLICK",
"[link] Check status\u00a0\u00bb for flight, 1957 of American Airlin... -> CLICK"
]
},
{
"website": "aa",
"id": "a51b649f-15b4-4ce4-936e-0b76efa0dd2d",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "View travel credits for the passenger Leon Sin with the record locator jcqnhd ans ticket number 1234567",
"action_reprs": [
"[searchbox] Search AA.com\u00ae -> TYPE: travel credit",
"[searchbox] Search AA.com\u00ae -> ENTER",
"[heading] Find your trip - Find a reservation - American Air... -> CLICK",
"[textbox] Last name -> TYPE: sin",
"[textbox] Trip Credit / Ticket number -> TYPE: 1234567",
"[adc-button] Find travel credit -> CLICK"
]
},
{
"website": "cargurus",
"id": "36b86ab8-a448-46f7-813f-3e3b5c3d687c",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "find offer for a black Honda with vin number 1HGCM66543A064159 with 155000 millage near 49102. The car should be in good condition with no damage, 2+ keys and paid off.",
"action_reprs": [
"[label] VIN -> CLICK",
"[textbox] Enter VIN (17 digits) Where can I find the VIN -> TYPE: 1HGCM66543A064159",
"[button] Get your offer -> CLICK",
"[textbox] ZIP Code -> TYPE: 49102",
"[button] Next -> CLICK",
"[textbox] Mileage -> TYPE: 155000",
"[button] Next -> CLICK",
"[span] Black -> CLICK",
"[button] Next -> CLICK",
"[button] None -> CLICK",
"[combobox] CONDITION -> SELECT: Good",
"[combobox] TIRE_CONDITION -> SELECT: Good To Go",
"[button] No -> CLICK",
"[button] No -> CLICK",
"[button] No -> CLICK",
"[button] No -> CLICK",
"[button] No -> CLICK",
"[button] No -> CLICK",
"[button] No -> CLICK",
"[button] 2+ -> CLICK",
"[radio] Owned -> CLICK",
"[button] Next -> CLICK",
"[button] Get my offer -> CLICK"
]
},
{
"website": "budget",
"id": "a919aa15-2acf-4090-8468-1d3a0d6450b1",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Need the cheapest small car on April 7, 10 am at Auckland airport for pick-up, return will be on April 10 at approx 5 pm.",
"action_reprs": [
"[button] Reservations -> HOVER",
"[link] Make a Reservation -> CLICK",
"[textbox] Enter your pick-up location or zip code -> TYPE: AUCKLAND",
"[span] Auckland Airport -> CLICK",
"[textbox] mm/dd/yyyy -> CLICK",
"[link] 7 -> CLICK",
"[combobox] Pick Up Time -> SELECT: 10:00 AM",
"[textbox] mm/dd/yyyy -> CLICK",
"[link] 10 -> CLICK",
"[combobox] Return Time -> SELECT: 5:00 PM",
"[generic] Vehicle Type * -> CLICK",
"[p] Compact -> CLICK",
"[button] Select My Car -> CLICK",
"[link] Pay Now -> CLICK",
"[button] Continue -> CLICK"
]
},
{
"website": "budget",
"id": "b02e47ac-c1a6-4f5c-886f-f32af745e7f3",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "View a reservation made under the last name Walker in Australia for a car using the reservation confirmation number A987654.",
"action_reprs": [
"[link] close dialog -> CLICK",
"[button] Reservations -> CLICK",
"[link] View / Modify / Cancel -> CLICK",
"[combobox] Select Residency -> SELECT: AUSTRALIA",
"[input] -> TYPE: Walker",
"[input] -> TYPE: A987654",
"[button] Find Reservation -> CLICK"
]
},
{
"website": "budget",
"id": "b5d47068-b773-4061-b7ba-17bd25e88e06",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Save two deals and offers for US.",
"action_reprs": [
"[button] Deals -> HOVER",
"[button] Deals -> CLICK",
"[link] US Deals -> CLICK",
"[button] Save Now -> CLICK",
"[button] Deals -> CLICK",
"[link] US Deals -> CLICK",
"[button] Save Now -> CLICK"
]
},
{
"website": "budget",
"id": "b8cfdd2c-c48d-4a58-84fb-a88514baf637",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Look for an available full-time job in USA finance, save all the accountant jobs.",
"action_reprs": [
"[link] Careers -> CLICK",
"[link] Openings -> CLICK",
"[button] Country -> CLICK",
"[searchbox] Search -> CLICK",
"[option] United States of America -> CLICK",
"[button] Team -> CLICK",
"[searchbox] Search -> CLICK",
"[option] Finance -> CLICK",
"[button] Time Type -> CLICK",
"[searchbox] Search -> CLICK",
"[option] Full time -> CLICK",
"[button] SEARCH BY JOB TITLE OR KEYWORD -> CLICK"
]
},
{
"website": "resy",
"id": "60bfb72f-e7a5-414f-990c-8ddd569744f4",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "What are the top restaurants in Boston to reserve for april 22?",
"action_reprs": [
"[path] -> CLICK",
"[button] Boston -> CLICK",
"[link] {{ 'see_more_label' | translate }} {{::list.info.n... -> CLICK",
"[button] Today -> CLICK",
"[button] April 22, 2023. -> CLICK"
]
},
{
"website": "resy",
"id": "75db63ac-4fcf-400e-833f-d31f00cf6ab6",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Find nearby top-rated restaurants in Chicago, save the restaurant, and then book a table for 7 people on April 20 for lunch at 2 pm.",
"action_reprs": [
"[link] Nearby Restaurants -> CLICK",
"[div] Toronto -> CLICK",
"[button] Chicago -> CLICK",
"[button] Today -> CLICK",
"[button] April 20, 2023. -> CLICK",
"[combobox] Party of 2 -> SELECT: 7 Guests",
"[svg] -> CLICK",
"[button] View more availability for Canal Street Eatery & M... -> CLICK",
"[button] 2:00 PM Eatery -> CLICK",
"[button] Reserve Now -> CLICK",
"[button] Done -> CLICK"
]
},
{
"website": "amtrak",
"id": "8df744ef-83ee-4472-9fb0-25bd9cf9dcd9",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Get a ten-ride ticket from Washington to New york starting from April 5",
"action_reprs": [
"[tab] Rail Passes -> CLICK",
"[link] EXPLORE MULTI-RIDE PASSES -> CLICK",
"[textbox] From -> TYPE: WASHINGTON",
"[option] Washington, DC - Union Station (WAS) -> CLICK",
"[textbox] To -> TYPE: NEW YORK",
"[option] New York, NY - Moynihan Train Hall at Penn Sta. (N... -> CLICK",
"[textbox] Select a trip start date -> CLICK",
"[gridcell] Wednesday, April 5, 2023 -> CLICK",
"[button] Done -> CLICK",
"[button] Continue -> CLICK",
"[button] Ticket Price $662 -> CLICK"
]
},
{
"website": "spothero",
"id": "bba6dd60-babd-4d8d-9e8b-242b0ffc08d7",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find guide for paying with commuter benefits.",
"action_reprs": [
"[p] About -> HOVER",
"[link] SpotHero for Business -> CLICK",
"[button] Download Guide -> CLICK"
]
},
{
"website": "spothero",
"id": "bf008019-bffd-42ad-a48b-054488e1458c",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find a parking near any NBA arena to enter today after 5 pm and exit after 8 pm",
"action_reprs": [
"[link] View All Stadiums -> CLICK",
"[link] Book Now -> CLICK",
"[tab] Hourly -> CLICK",
"[combobox] Start Time -> SELECT: 5:00 PM",
"[combobox] End Time -> SELECT: 8:00 PM",
"[button] Search -> CLICK"
]
},
{
"website": "ebay",
"id": "1f128c19-3093-4c49-bfc7-13589aa8e88a",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Get a Hasbro Hulk action figure manufactured in 1990 with the lowest price + shipping.",
"action_reprs": [
"[link] Toys -> HOVER",
"[link] Action Figures -> CLICK",
"[img] Hasbro -> CLICK",
"[button] All Filters -> CLICK",
"[tab] Character -> CLICK",
"[checkbox] Hulk -> CLICK",
"[tab] Year Manufactured -> CLICK",
"[checkbox] 1990 -> CLICK",
"[button] Apply -> CLICK",
"[input] -> CLICK",
"[button] Sort selector. Best Match selected. -> CLICK",
"[link] Price + Shipping: lowest first -> CLICK"
]
},
{
"website": "ebay",
"id": "270c18c6-b3cf-4409-ba6b-18160525692f",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Find the cheapest used and working Nintendo Switch for under $400 that can be bought right now.",
"action_reprs": [
"[combobox] Search for anything -> TYPE: Nintendo Switch Console",
"[button] Search -> CLICK",
"[textbox] Maximum Value in $ -> TYPE: 400",
"[button] Submit price range -> CLICK",
"[input] -> CLICK",
"[input] -> CLICK",
"[button] Sort selector. Best Match selected. -> CLICK",
"[link] Price + Shipping: lowest first -> CLICK",
"[input] -> CLICK"
]
},
{
"website": "amtrak",
"id": "2b562465-e325-4743-8e68-6e7852594f93",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find the terms and conditions of Amtrak RideReserve for Multi-Ride Passes",
"action_reprs": [
"[button] DEALS -> CLICK",
"[link] MULTI-RIDES & RAIL PASSES USA Rail passes, monthly... -> CLICK",
"[img] -> CLICK",
"[link] EXPLORE MULTI-RIDE PASSES -> CLICK",
"[label] RideReserve for Multi-Ride Passes Terms -> CLICK"
]
},
{
"website": "ryanair",
"id": "87ca0d6a-c513-4aae-b14f-7d4db3255e98",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Search for a flight from Dublin in Ireland to Paris Beauvais in france for 2 adults leaving apr 26 and returning may 2 with the promo code 10000001",
"action_reprs": [
"[textbox] From -> CLICK",
"[button] Ireland -> CLICK",
"[span] Dublin -> CLICK",
"[button] France -> CLICK",
"[span] Paris Beauvais -> CLICK",
"[generic] 26 -> CLICK",
"[generic] 2 -> CLICK",
"[div] -> CLICK",
"[button] Apply promo code -> CLICK",
"[textbox] Apply promo code -> TYPE: 1000001",
"[button] Search -> CLICK"
]
},
{
"website": "ryanair",
"id": "b5c98548-4a3f-4e7c-8287-c36963930348",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Get a rental car to pick up at Paris Charles de Gaulle Airport CDG on april 13 at 10 am and drop off on april 18 at the same time",
"action_reprs": [
"[div] Car Hire -> CLICK",
"[textbox] I need a car in -> TYPE: Paris Charles de Gaulle Airport (CDG)",
"[button] Paris Charles de Gaulle Airport (CDG) Paris, Franc... -> CLICK",
"[generic] 13 -> CLICK",
"[generic] 18 -> CLICK",
"[button] 10:00 -> CLICK",
"[button] 10:00 -> CLICK",
"[button] Let's go -> CLICK"
]
},
{
"website": "bookdepository",
"id": "58f811fd-0f17-430b-befc-885605e13e41",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Cancel an order with order number X123456 of Harry Potter Box Set as not available at address.",
"action_reprs": [
"[link] Cancel my order -> CLICK",
"[input] -> TYPE: James Smith",
"[textbox] Email address used to place your order * -> TYPE: buckeye.foobar@gmail.com",
"[textbox] Order number * -> TYPE: X123456",
"[textbox] Date you received your order (DD/MM/YY) * -> TYPE: 08/04/23",
"[textbox] Please cancel my order for the following products ... -> TYPE: Harry Potter Box Set",
"[textbox] Reason for cancellation (optional) * -> TYPE: Not available at address",
"[button] Cancel order -> HOVER"
]
},
{
"website": "ticketcenter",
"id": "73de3022-2f58-4bd4-8de6-4a201f2bbc98",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Check if there are tickets availabe for the Hamilton musical in Richmond, VA.",
"action_reprs": [
"[textbox] Search for artists, teams or venues... -> TYPE: Hamilton",
"[option] Hamilton -> CLICK"
]
},
{
"website": "ticketcenter",
"id": "8d9e09e1-c31a-420b-ace8-079204db551a",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Select a ticket for an event similar to professional boxing",
"action_reprs": [
"[textbox] Search for artists, teams or venues... -> TYPE: professional boxing",
"[option] Professional Boxing -> CLICK",
"[link] CES Boxing -> CLICK",
"[link] TICKETS -> CLICK"
]
},
{
"website": "rei",
"id": "4e3cc9e2-baf7-449f-bf61-919eb773f29c",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find Travel Pack for hiking.",
"action_reprs": [
"[button] Travel -> CLICK",
"[link] Travel Backpacks -> CLICK",
"[link] add filter: Hiking(2) -> CLICK"
]
},
{
"website": "airbnb",
"id": "a52774d2-550d-475a-922c-25c37d44557c",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "I want to see mansions for 3 adults to stay in in europe during any month",
"action_reprs": [
"[span] Mansions -> CLICK",
"[button] Location Anywhere -> CLICK",
"[div] -> CLICK",
"[button] Check in / Check out Any week -> CLICK",
"[tab] Flexible dates -> CLICK",
"[label] Month -> CLICK",
"[div] Add guests -> CLICK",
"[path] -> CLICK",
"[button] increase value -> CLICK",
"[svg] -> CLICK",
"[span] -> CLICK"
]
},
{
"website": "rei",
"id": "d6c1c4f5-74a7-4451-8dd2-aabada5d7ba1",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find rental charges for bikes in 37863.",
"action_reprs": [
"[link] Find a Store -> CLICK",
"[textbox] Enter ZIP or City, State -> TYPE: 37863",
"[path] -> CLICK",
"[generic] Bike shop Pigeon Forge -> CLICK",
"[link] See services menu for Rentals -> CLICK",
"[button] image of rental category item Cycling Gear -> CLICK"
]
},
{
"website": "rentalcars",
"id": "02142919-1e63-4059-9471-419158e159a7",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Check prices for luxury sedan car in Houston with insurance.",
"action_reprs": [
"[textbox] Pick-up location -> TYPE: Houston",
"[button] Place Houston, TX -> CLICK",
"[div] Search -> CLICK",
"[img] -> CLICK",
"[button] View deal -> CLICK",
"[button] Go to book With Collision Damage Coverage -> CLICK"
]
},
{
"website": "united",
"id": "ab23e83a-e3bd-4648-9d68-989f5c158d8f",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Request a refund for the traveler Ian Lo and, his document number is 12345678912345 and email ian.lo@gmail.com",
"action_reprs": [
"[tab] MY TRIPS -> CLICK",
"[link] Request a refund -> CLICK",
"[button] Add trip -> CLICK",
"[textbox] Last Name* -> TYPE: Lo",
"[textbox] Confirmation or ticket number* -> TYPE: 12345678912345",
"[button] Add flight -> CLICK",
"[textbox] Email address * -> TYPE: ian.lo@gmail.com",
"[button] Continue -> CLICK"
]
},
{
"website": "united",
"id": "af8a7016-67db-4a6d-ab61-04eeb1f244cb",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find a round trip from Phoenix to Miami with maximum budget of $2000.",
"action_reprs": [
"[combobox] Flying from -> TYPE: Phoenix",
"[button] Phoenix, AZ, US (PHX) -> CLICK",
"[button] Search -> CLICK",
"[button] List of search results -> CLICK",
"[span] Tue, Apr 25 - Tue, May 2 from -> CLICK"
]
},
{
"website": "cvs",
"id": "2281faf9-ff02-42e3-b785-8bcc3a0e530a",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Look up information on the potential side effects of rogaine.",
"action_reprs": [
"[combobox] Search products and services -> TYPE: rogaine",
"[img] Men's Rogaine Extra Strength 5% Minoxidil Solution -> CLICK",
"[heading] Warnings -> CLICK"
]
},
{
"website": "cvs",
"id": "27724810-0bc8-446a-a2f4-b53a87e190df",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find the location and operating hours of the nearest CVS pharmacy to zip code 90028",
"action_reprs": [
"[button] change store -> CLICK",
"[textbox] Search by Zip Code, City, State, or Landmark -> TYPE: 90028",
"[button] Submit Search -> CLICK"
]
},
{
"website": "cvs",
"id": "51e85ea8-7a75-40f3-8f35-ed255f87171f",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Add to cart 2 bottles of vitamin D that are buy 1 get 1 free and new arrival.",
"action_reprs": [
"[button] Shop -> CLICK",
"[button] load Vitamins Menu -> CLICK",
"[button] load Vitamins A-Z Menu -> CLICK",
"[link] Vitamin D -> CLICK",
"[checkbox] Buy 1, Get 1 Free 33 items, On Sale list 3 items -> CLICK",
"[img] -> CLICK",
"[button] Add Nature's Bounty Vitamin D3 Immune Health 125mc... -> CLICK"
]
},
{
"website": "newegg",
"id": "2a7f7732-ec9b-4d78-91ad-f0fe10bf7daf",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "Find a gaming pc which can run Call of Duty Warzone at 4k.",
"action_reprs": [
"[generic] Site Menu -> CLICK",
"[link] icon of Gaming PC Finder Gaming PC Finder -> CLICK",
"[button] 4K -> CLICK",
"[div] Remove -> CLICK",
"[button] VIEW RESULTS -> CLICK"
]
},
{
"website": "ign",
"id": "4f395aad-6f10-4055-932a-d2af443e6bfa",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Find Star Wars The Mandalorian statue and add to cart.",
"action_reprs": [
"[searchbox] Search... -> TYPE: Star Wars The Mandalorian statue",
"[img] The Mandalorian ArtFX+ 1/10th Scale Statue - Manda... -> CLICK",
"[button] Add to cart -> CLICK"
]
},
{
"website": "ign",
"id": "4faf56f2-217b-4d2d-b510-a24e30e6b20e",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Find a list of all movies that are being released in May 2023",
"action_reprs": [
"[button] Reviews -> CLICK",
"[button] HOME -> CLICK",
"[button] Discover -> CLICK",
"[link] Upcoming Movies -> CLICK",
"[tab] MAY '23 -> CLICK"
]
},
{
"website": "uniqlo",
"id": "f1f4e4f7-3fb0-4aeb-8123-4882a1f39cb2",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Find the new arrival of kids graphic t-shirt for 13 years old boy",
"action_reprs": [
"[link] KIDS -> CLICK",
"[tab] Tops -> CLICK",
"[link] UT: Graphic Tees -> CLICK",
"[gridcell] Size -> CLICK",
"[label] 13Y(160) -> CLICK",
"[button] Sort by -> CLICK",
"[option] New arrivals -> CLICK"
]
},
{
"website": "cvs",
"id": "978376c1-8545-4160-81d5-722bdea60434",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Start the process to sign up for CVS ExtraCare",
"action_reprs": [
"[button] Prescriptions -> CLICK",
"[link] Pharmacy & Health Rewards -> CLICK",
"[link] Join ExtraCare Pharmacy & Health Rewards -> CLICK"
]
},
{
"website": "cvs",
"id": "9a9b1b45-cb23-4073-897f-67410087df9d",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Schedule COVID-19 test appointment at 90028.",
"action_reprs": [
"[span] COVID-19 booster, testing, treatment & records -> CLICK",
"[link] COVID-19 testing Schedule a COVID-19 test -> CLICK",
"[textbox] Where do you live? (required) -> TYPE: 90028",
"[button] Schedule a test -> CLICK"
]
},
{
"website": "cvs",
"id": "bb7c3e38-dd9c-4472-9774-0012586a1dcd",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Show weekly deals of Columbus, Oh 43215 store.",
"action_reprs": [
"[link] Locations -> CLICK",
"[combobox] Search by ZIP code, city, or state -> TYPE: 43215",
"[span] Columbus, Ohio -> CLICK",
"[link] View weekly deals -> CLICK"
]
},
{
"website": "booking",
"id": "4272e233-3440-4572-bd86-b3a2b22a4061",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Find the most popular tours and attractions in Kyoto, Japan from May 25 with free cancellation option, check availability for 2 adults and 1 infant, and book.",
"action_reprs": [
"[span] Attractions -> CLICK",
"[span] Asia -> CLICK",
"[div] Kyoto -> CLICK",
"[div] Select your dates -> CLICK",
"[svg] -> CLICK",
"[checkbox] 25 May 2023 -> CLICK",
"[span] -> CLICK",
"[span] -> CLICK",
"[span] -> CLICK",
"[label] Most popular -> CLICK",
"[span] See availability -> CLICK",
"[button] Show more dates -> CLICK",
"[svg] -> CLICK",
"[checkbox] 25 May 2023 -> CLICK",
"[svg] -> CLICK",
"[svg] -> CLICK",
"[svg] -> CLICK",
"[button] Next -> CLICK"
]
},
{
"website": "booking",
"id": "6ab8130f-362c-4fc3-bdab-d0528f0c6181",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Book the cheapest 3-star hotel or resort for two within a budget of 50 to 100 dollars for four days starting from April 25, near the beach in goa that offers breakfast, wifi, a swimming pool, and free cancellation.",
"action_reprs": [
"[textbox] Where are you going? -> TYPE: GOA",
"[div] Goa -> CLICK",
"[checkbox] 25 April 2023 -> CLICK",
"[checkbox] 29 April 2023 -> CLICK",
"[button] Search -> CLICK",
"[span] -> CLICK",
"[span] -> CLICK",
"[span] -> CLICK",
"[span] -> CLICK",
"[span] -> CLICK",
"[span] -> CLICK",
"[span] -> CLICK",
"[span] -> CLICK",
"[button] Sort by:Our top picks -> CLICK",
"[div] Price (lowest first) -> CLICK",
"[link] See availability -> CLICK",
"[button] Reserve -> CLICK",
"[button] Reserve with Genius discount -> CLICK"
]
},
{
"website": "newegg",
"id": "e344b89e-767a-4618-ba82-4b81cdcba280",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "add a motherboard under $200 and a compatible processor at any price to the shopping cart.",
"action_reprs": [
"[searchbox] Search Site -> TYPE: motherboard",
"[button] \uf002 -> CLICK",
"[textbox] price to -> TYPE: 200",
"[button] APPLY -> CLICK",
"[link] GIGABYTE B450M DS3H WIFI AM4 AMD B450 SATA 6Gb/s M... -> CLICK",
"[a] Processors - Desktops -> CLICK",
"[div] AMD Ryzen 5 5600 - Ryzen 5 5000 Series Vermeer (Ze... -> CLICK",
"[button] ADD 2 ITEMS TO CART \uf0da -> CLICK"
]
},
{
"website": "tesla",
"id": "71638c81-42f0-4218-a1b0-d3a137ad1cff",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Check the price of Tesla Model Y Performance for the 10001 zip code.",
"action_reprs": [
"[link] Model Y -> CLICK",
"[link] Order Now -> CLICK",
"[div] Dual Motor All-Wheel Drive -> CLICK",
"[button] 43235 -> CLICK",
"[input] -> TYPE: 10001",
"[button] Confirm -> CLICK"
]
},
{
"website": "spothero",
"id": "40cd58cd-6c9a-47b9-a927-92243970d87a",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find monthly daytime only parking nearest to Madison Square Garden starting from April 22",
"action_reprs": [
"[tab] Monthly -> CLICK",
"[textbox] Search for parking -> TYPE: madison square garden",
"[li] Madison Square Garden, Pennsylvania Plaza, New Yor... -> CLICK",
"[select] All Parking Options -> SELECT: Daytime Only Parking",
"[textbox] Monthly Start Date -> CLICK",
"[gridcell] Sat Apr 22 2023 -> CLICK",
"[button] Update Search -> CLICK"
]
},
{
"website": "spothero",
"id": "45ae95ac-e539-4314-a0ca-8947b1843890",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find a monthly parking with valet service at the New York University.",
"action_reprs": [
"[tab] Monthly -> CLICK",
"[textbox] Search for parking -> TYPE: New York University",
"[li] New York University, New York, NY, USA -> CLICK",
"[button] Filter -> CLICK",
"[checkbox] Valet (15) -> CLICK",
"[button] Show 15 Results -> CLICK"
]
},
{
"website": "spothero",
"id": "4ee7d5e1-50be-49d2-8af1-83b3da0519ad",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Show the details for a monthly parking option in Ney York City near Street Taco to start on may 6 that i can self park",
"action_reprs": [
"[tab] Monthly -> CLICK",
"[textbox] Search for parking -> TYPE: street taco",
"[li] Street Taco, Broadway, New York, NY, USA -> CLICK",
"[textbox] Monthly Start Date -> CLICK",
"[svg] -> CLICK",
"[gridcell] Sat May 06 2023 -> CLICK",
"[button] Update Search -> CLICK",
"[button] Filter -> CLICK",
"[checkbox] Self Park (1) -> CLICK",
"[button] Show 1 Results -> CLICK",
"[button] View Details -> CLICK"
]
},
{
"website": "rottentomatoes",
"id": "d4d4a01e-47d0-4e54-8bd5-3d85acebb6dd",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Find the latest action tv shows which are rated fresh by both the audience and the rotten tomatoes",
"action_reprs": [
"[link] TV SHOWS -> CLICK",
"[span] Sort: Most popular -> CLICK",
"[span] Newest -> CLICK",
"[span] Genre -> CLICK",
"[div] -> CLICK",
"[button] APPLY -> CLICK",
"[span] Audience score -> CLICK",
"[div] -> CLICK",
"[button] APPLY -> CLICK",
"[span] Tomatometer -> CLICK",
"[div] -> CLICK",
"[button] APPLY -> CLICK"
]
},
{
"website": "sixflags",
"id": "0fd460cc-679c-4d04-8816-c6460bdf895a",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Confirm my vip tour at the six flags Discovery Kingdom",
"action_reprs": [
"[button] Browse the Parks Below -> CLICK",
"[span] Six Flags Discovery Kingdom -> CLICK",
"[button] Go! -> CLICK",
"[link] Tickets, Passes, Tours \uf078 -> CLICK",
"[link] VIP Tours -> CLICK",
"[span] Confirm Your Tour -> CLICK"
]
},
{
"website": "amctheatres",
"id": "f8428085-905f-4190-9404-3e28fb691252",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Show me the newest on-demand releases.",
"action_reprs": [
"[link] Visit the On Demand page -> CLICK",
"[link] New Releases -> CLICK"
]
},
{
"website": "expedia",
"id": "8fb78266-8862-4608-9ff3-92f81e58b2ff",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Find the cheapest non-stop or 1 stop flight from JFK, New York to Changi, Singapore for 1 traveler on April 11 which includes seat selection and free cancellation",
"action_reprs": [
"[tab] Flights -> CLICK",
"[tab] One-way -> CLICK",
"[button] Leaving from -> CLICK",
"[textbox] Leaving from -> TYPE: jfk",
"[button] New York (JFK - John F. Kennedy Intl.) New York, U... -> CLICK",
"[button] Going to -> CLICK",
"[textbox] Going to -> TYPE: changi",
"[button] Singapore (SIN - Changi) Singapore -> CLICK",
"[button] Departing April 5, 2023 -> CLICK",
"[button] Apr 11, 2023 -> CLICK",
"[button] Done : (Save changes and close the date picker.) -> CLICK",
"[button] Search -> CLICK",
"[checkbox] Nonstop (1) -> CLICK",
"[checkbox] 1 Stop (49) -> CLICK",
"[checkbox] Seat choice included -> CLICK",
"[checkbox] No cancel fee -> CLICK",
"[combobox] Sort by -> SELECT: Price (Lowest)"
]
},
{
"website": "booking",
"id": "fc552b69-feb8-4951-bf67-725071bf8c8a",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Book fasted flexible direct flights from New York to Tokyo on June 1, between 6 to 12 pm departure, and from Tokyo to New Delhi on June 5.",
"action_reprs": [
"[span] Flights -> CLICK",
"[b] Columbus -> TYPE: NEW YORK",
"[span] -> CLICK",
"[svg] -> CLICK",
"[span] Where to? -> TYPE: TOKYO",
"[span] -> CLICK",
"[div] Multi-city -> CLICK",
"[span] Sat 13 May -> CLICK",
"[checkbox] 1 June 2023 -> CLICK",
"[span] Where from? -> TYPE: TOKYO",
"[span] TYO -> CLICK",
"[span] Where to? -> TYPE: NEW DELHI",
"[b] DEL -> CLICK",
"[button] Choose departure date -> CLICK",
"[checkbox] 5 June 2023 -> CLICK",
"[button] Search -> CLICK",
"[span] -> CLICK",
"[tab] Fastest -> CLICK",
"[button] See flight -> CLICK",
"[button] Select -> CLICK",
"[span] -> CLICK",
"[button] Next -> CLICK"
]
},
{
"website": "booking",
"id": "fdd4fc92-3b4d-48a6-9cfe-f66ffed422e6",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Find an entire home with a rating above 5 for two in Manila, Philippines from June 1 to 8 with self-catering, double bed, free wifi, and walk-in shower, check the availability, and reserve.",
"action_reprs": [
"[link] Homes -> CLICK",
"[searchbox] Please type your destination -> TYPE: MANILA",
"[option] Manila Luzon,\u00a0Philippines -> CLICK",
"[svg] -> CLICK",
"[gridcell] 1 June 2023 -> CLICK",
"[gridcell] 8 June 2023 -> CLICK",
"[button] Search -> CLICK",
"[span] -> CLICK",
"[button] Show all 14 -> CLICK",
"[span] -> CLICK",
"[button] Show all 25 -> CLICK",
"[span] -> CLICK",
"[span] -> CLICK",
"[span] -> CLICK",
"[link] See availability -> CLICK",
"[button] Reserve -> CLICK",
"[button] I'll\u00a0reserve -> CLICK"
]
},
{
"website": "ign",
"id": "521aa0aa-e099-4fc9-bb4e-f8a593a29f81",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Find the user reviews for the game \"Cyberpunk 2077\"",
"action_reprs": [
"[button] Search -> CLICK",
"[searchbox] Search -> TYPE: Cyberpunk 2077",
"[div] Cyberpunk 2077 -> CLICK"
]
},
{
"website": "sixflags",
"id": "521d9006-4560-49af-b232-c713d87dd2e2",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Buy a group ticket for 20 people in Six Flags Magic Mountain in Los Angeles on Apr 30, add 5 mega meal deals with it. Name the group Crew and check out as James Johnson, james.john@gmail.com. It is a family trip organized by Johnson.",
"action_reprs": [
"[button] Browse the Parks Below -> CLICK",
"[span] Six Flags Magic Mountain -> CLICK",
"[button] Go! -> CLICK",
"[link] Tickets, Passes, VIP Tours \uf078 -> CLICK",
"[link] Group Tickets -> CLICK",
"[i] -> CLICK",
"[button] Buy Tickets -> CLICK",
"[button] April 30, 2023 -> CLICK",
"[button] Buy Now -> CLICK",
"[generic] Increase -> CLICK",
"[generic] Increase -> CLICK",
"[generic] Increase -> CLICK",
"[generic] Increase -> CLICK",
"[generic] Increase -> CLICK",
"[generic] Increase -> CLICK",
"[generic] Increase -> CLICK",
"[generic] Increase -> CLICK",
"[generic] Increase -> CLICK",
"[generic] Increase -> CLICK",
"[button] Next -> CLICK",
"[input] -> TYPE: Crew",
"[input] -> TYPE: James",
"[input] -> TYPE: Johnson",
"[input] -> TYPE: james.john@gmail.com",
"[combobox] Organization Type -> SELECT: Family Trip",
"[input] -> TYPE: Johnson",
"[button] Continue -> CLICK"
]
},
{
"website": "rei",
"id": "1bf4f465-99cb-483b-aac1-a7512b150755",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find a hydropack and make the results to show only items that have a capacity of 21 to 35L.",
"action_reprs": [
"[button] Camp & Hike -> CLICK",
"[li] Hydration Packs -> CLICK",
"[link] add filter: 21 to 35(23) -> CLICK"
]
},
{
"website": "rei",
"id": "277a776a-b335-4761-a543-bed1c6eca1d6",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Search for kayaks and filter the results to show only those that are suitable for whitewater rapids.",
"action_reprs": [
"[searchbox] Search -> CLICK",
"[searchbox] Search -> TYPE: Kayaks",
"[option] kayaks -> CLICK",
"[link] Whitewater Kayaks (4) -> CLICK"
]
},
{
"website": "redbox",
"id": "a63b891b-4703-46ab-8633-b151b26574d1",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Find the software requirements for iPhones that support live tv on demand streaming.",
"action_reprs": [
"[link] Navigate to on-demand -> HOVER",
"[link] select to navigate to Supported Devices -> CLICK",
"[generic] FREE LIVE TV -> CLICK",
"[generic] ... -> CLICK"
]
},
{
"website": "redbox",
"id": "c5871c3f-27c3-48d8-bdf9-8b49382a2719",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Add 3 movies from At the Kiosk which are new to Wishlist.",
"action_reprs": [
"[link] Navigate to at-the kiosk -> CLICK",
"[link] Navigate to New Releases At The Kiosk See More -> CLICK",
"[img] Plane (2023) -> CLICK",
"[button] Click to add title to wishlist. -> CLICK",
"[link] Navigate to at-the kiosk -> HOVER",
"[link] select to navigate to New -> CLICK",
"[img] Missing (2023) -> CLICK",
"[button] Click to add title to wishlist. -> CLICK",
"[link] Navigate to at-the kiosk -> HOVER",
"[link] select to navigate to New -> CLICK",
"[img] M3GAN -> CLICK",
"[button] Click to add title to wishlist. -> CLICK"
]
},
{
"website": "eventbrite",
"id": "74cb088a-06d9-4a5e-9b00-61fd6b874e89",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Find exercise events taking place in San Francisco between July 10-31.",
"action_reprs": [
"[link] Sports & Fitness -> CLICK",
"[svg] -> CLICK",
"[combobox] autocomplete -> TYPE: San Francisco",
"[div] CA, USA -> CLICK",
"[svg] -> CLICK",
"[div] Calendar -> CLICK",
"[generic] next -> CLICK",
"[generic] next -> CLICK",
"[generic] next -> CLICK",
"[generic] next -> CLICK",
"[button] 10 -> CLICK",
"[button] 31 -> CLICK",
"[img] Exercise -> CLICK"
]
},
{
"website": "eventbrite",
"id": "7cd5a347-0e44-4ea2-8fcf-45fec1844279",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Find music event organizers and follow the second one.",
"action_reprs": [
"[link] Music -> CLICK",
"[button] Follow -> CLICK"
]
},
{
"website": "eventbrite",
"id": "8634bbc0-7bcd-4c88-ad0f-5c73c3f69e53",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Join the waitlist for a ticket for the Hackney Clothes Swap - Earth Day event being held on April 22nd. Name: Joe Bloggs. Email: joe@bloggs.com",
"action_reprs": [
"[div] Search for events -> CLICK",
"[combobox] autocomplete -> TYPE: Hackney",
"[div] Hackney -> CLICK",
"[combobox] autocomplete -> CLICK",
"[combobox] autocomplete -> TYPE: Hackney",
"[div] London, UK -> CLICK",
"[textbox] Search events -> TYPE: Hackney Clothes Swap - Earth Day",
"[div] Hackney Clothes Swap - Earth Day -> CLICK",
"[button] Get tickets -> CLICK",
"[button] Join Waitlist -> CLICK",
"[textbox] First Name * (required) -> TYPE: Joe",
"[textbox] Surname * (required) -> TYPE: Bloggs",
"[textbox] Email * (required) -> TYPE: joe@bloggs.com"
]
},
{
"website": "eventbrite",
"id": "920f240d-77a9-476b-a1d4-dcc88d199bfa",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Find rock music events in Canada, happening this weekend and save top three popular events for my record.",
"action_reprs": [
"[link] Music -> CLICK",
"[svg] -> CLICK",
"[div] Canada -> CLICK",
"[svg] -> CLICK",
"[div] This weekend -> CLICK",
"[p] Rock -> CLICK",
"[button] Save Chinatown Nights: A Neon Dream to your collec... -> CLICK",
"[svg] -> CLICK",
"[svg] -> CLICK"
]
},
{
"website": "kbb",
"id": "f1db33c6-c414-438b-bbfc-cdaa6cfc6b68",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Check reviews for best electric SUV and find the 1 star rated review and mark it helpful.",
"action_reprs": [
"[link] Car Reviews -> HOVER",
"[link] Best Cars -> CLICK",
"[img] Best SUVs image -> CLICK",
"[div] SUVs -> CLICK",
"[link] See Details -> CLICK",
"[span] 11% -> CLICK",
"[button] helpful -> CLICK"
]
},
{
"website": "kbb",
"id": "fb9c0e7f-02dd-453f-8c73-da19282abf84",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Find a Ford Mustang with lowest price and save it.",
"action_reprs": [
"[link] Cars for Sale -> HOVER",
"[link] Cars for Sale -> CLICK",
"[textbox] Search by Make, Model, Body Style or Keyword -> TYPE: Mustang",
"[div] Ford -> CLICK",
"[combobox] Sort By: -> SELECT: Price - Lowest",
"[heading] Used 2000 Ford Mustang GT -> CLICK",
"[span] -> CLICK",
"[button] Save -> CLICK"
]
},
{
"website": "airbnb",
"id": "58394242-6531-4791-a7fc-6f279037706c",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Favorite a shared room in Belo Horizonte costing up to $100 to stay in a weekend in May",
"action_reprs": [
"[button] Location Anywhere -> CLICK",
"[textbox] Where -> TYPE: belo horizonte",
"[div] Belo Horizonte, Minas Gerais, Brazil -> CLICK",
"[tab] Flexible dates -> CLICK",
"[label] Weekend -> CLICK",
"[div] May -> CLICK",
"[span] -> CLICK",
"[span] Filters -> CLICK",
"[textbox] max price $ -> TYPE: 100",
"[div] Shared room -> CLICK",
"[link] Show 71 stays -> CLICK",
"[path] -> CLICK"
]
},
{
"website": "last.fm",
"id": "f9723022-04b9-4778-ad33-cf54eac3d393",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Find events starting from April 1, 2023 within 100 miles of New York and see who are going in the top listed event and follow all of them who are going.",
"action_reprs": [
"[link] Events -> CLICK",
"[button] Near you -> CLICK",
"[textbox] Location search -> TYPE: new york",
"[span] New York -> CLICK",
"[combobox] SEARCH RADIUS -> SELECT: 100 km",
"[button] APPLY -> CLICK",
"[button] From today -> CLICK",
"[Date] FROM -> CLICK",
"[Date] FROM -> TYPE: 04/01/2023",
"[button] APPLY -> CLICK",
"[link] 3 going -> CLICK",
"[button] -> CLICK",
"[button] -> CLICK",
"[button] -> CLICK"
]
},
{
"website": "sports.yahoo",
"id": "37564222-bb58-4a55-b47b-e9ffbbc1d160",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Find the results of the most recent NFL games.",
"action_reprs": [
"[link] NFL . -> CLICK",
"[link] Scores/Schedule -> CLICK"
]
},
{
"website": "sports.yahoo",
"id": "3e142eee-7a62-4ad7-ae16-419d596ab63b",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Find the list of injured NBA players.",
"action_reprs": [
"[link] NBA . -> HOVER",
"[link] Injuries . -> CLICK"
]
},
{
"website": "sports.yahoo",
"id": "56e4a9c1-d39e-4173-9857-9cf980c0fba9",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Follow the Denver Nuggets NBA team.",
"action_reprs": [
"[link] NBA . -> HOVER",
"[div] Denver -> CLICK",
"[button] Follow team -> CLICK"
]
},
{
"website": "sports.yahoo",
"id": "63d1f820-37bf-4adb-aabb-65eb7925790c",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Find the current roster of the Miami Heat.",
"action_reprs": [
"[link] NBA . -> HOVER",
"[img] -> CLICK",
"[link] Roster -> CLICK"
]
},
{
"website": "kohls",
"id": "1a16a98f-4e8f-4ff9-9fa2-b97d2d403cc3",
"domain": "Shopping",
"subdomain": "Department",
"confirmed_task": "Add a set of sonoma bath towels to the cart and apply a coupon code for free shipping.",
"action_reprs": [
"[textbox] Search by keyword or web id -> TYPE: bath towels",
"[span] bath towels -> CLICK",
"[img] Sonoma Goods For Life\u00ae Ultimate Bath Towel with Hy... -> CLICK",
"[link] BATH TOWEL -> CLICK",
"[button] Add to Cart -> CLICK",
"[button] View Cart & Checkout -> CLICK",
"[textbox] Add Kohl's Cash or Coupons -> TYPE: FREESHIP3093",
"[button] Add Kohl's Cash or Coupon button -> CLICK"
]
},
{
"website": "travelzoo",
"id": "0633c328-f1ad-42bd-8aec-7a1883b5898d",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Find a luxury trip deal anywhere to go in spring",
"action_reprs": [
"[textbox] What type of deals? -> CLICK",
"[div] Luxury Trips -> CLICK",
"[div] Anywhere -> CLICK",
"[textbox] When? -> CLICK",
"[li] Spring -> CLICK",
"[button] SEARCH DEALS -> CLICK"
]
},
{
"website": "travelzoo",
"id": "1ba150cb-3b4a-4f0a-bff0-b448c78608ae",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Find hotel deals in Las Vegas for four adults starting on May 17 and ending on May 20, and if deal is not available, set an alert for the same.",
"action_reprs": [
"[textbox] What type of deals? -> CLICK",
"[div] Hotels -> CLICK",
"[textbox] Where? -> TYPE: las vegas",
"[div] Las Vegas, NV -> CLICK",
"[textbox] When? -> CLICK",
"[link] 17 -> CLICK",
"[link] 20 -> CLICK",
"[combobox] How many guests? -> SELECT: 4 Guests",
"[button] SEARCH DEALS -> CLICK",
"[button] SET AN ALERT FOR LAS VEGAS -> CLICK"
]
},
{
"website": "travelzoo",
"id": "1c1af35c-a0d7-4fe8-bcd3-baf30862235b",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Show most expensive cruise deals in Europe and Mediterranean.",
"action_reprs": [
"[link] Cruises -> CLICK",
"[link] Europe & Mediterranean Cruises 16 DEALS -> CLICK",
"[button] Filter -> CLICK",
"[button] $ Price: High to Low -> CLICK",
"[button] DONE -> CLICK"
]
},
{
"website": "travelzoo",
"id": "33964bc4-fc1d-417c-ba5a-2c1c45ed8d8b",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Show me the most expensive things to do anywhere in December in a map",
"action_reprs": [
"[textbox] What type of deals? -> CLICK",
"[div] Things To Do -> CLICK",
"[div] Anywhere -> CLICK",
"[textbox] When? -> CLICK",
"[tab] Select a Month -> CLICK",
"[li] December -> CLICK",
"[button] Filter -> CLICK",
"[button] $ Price: High to Low -> CLICK",
"[button] DONE -> CLICK",
"[span] Map -> CLICK"
]
},
{
"website": "united",
"id": "401c4e6f-6b0b-47b4-8157-92d7ca468bbc",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "rent a car in Brooklyn - Central, NY on from April 9 to April 15.",
"action_reprs": [
"[heading] CAR -> CLICK",
"[combobox] Enter pick up city, airport name, or airport code. -> TYPE: Brooklyn Central",
"[div] Brooklyn - Central (New York), US -> CLICK",
"[textbox] Pickup -> CLICK",
"[button] Sunday, April 9, 2023 -> CLICK",
"[button] Saturday, April 15, 2023 -> CLICK",
"[button] Find cars button. -> CLICK"
]
},
{
"website": "ign",
"id": "00e83fae-f2f0-48ab-912c-32c03982642b",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Show computer game reviews sorted by score.",
"action_reprs": [
"[button] Reviews -> CLICK",
"[link] Game Reviews -> CLICK",
"[combobox] Platform -> SELECT: PC",
"[combobox] Sort -> SELECT: Sort by Score"
]
},
{
"website": "discogs",
"id": "74f01011-9bcd-433b-8405-975ca5c3f356",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Find the address and store hours for the Armageddon Shop record store in Boston.",
"action_reprs": [
"[button] Community -> CLICK",
"[link] Record Stores -> CLICK",
"[link] Explore the directory -> CLICK",
"[searchbox] Refine Location -> TYPE: Boston",
"[span] MA, USA -> CLICK",
"[button] Armageddon Shop -> CLICK"
]
},
{
"website": "discogs",
"id": "bd32af6e-9fae-4968-b3e6-d143f148f5b8",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Buy a copy of the Gorillaz first studio album.",
"action_reprs": [
"[combobox] Search artists, albums and more... -> TYPE: gorillaz",
"[link] Gorillaz Gorillaz Artist -> CLICK",
"[link] Gorillaz -> CLICK",
"[link] Buy a copy -> CLICK",
"[link] Add\u00a0to\u00a0Cart -> CLICK"
]
},
{
"website": "discogs",
"id": "c731e6d1-7194-4d16-a6a8-f5fc9be56a55",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Buy a pop rock album CD from the United Kingdom that was released in 2016, is between \u00a315 and \u00a320 and in perfect condition.",
"action_reprs": [
"[button] Marketplace -> CLICK",
"[link] Pop Rock -> CLICK",
"[link] 958,222 United Kingdom -> CLICK",
"[link] 246,685 CD -> CLICK",
"[link] 122,512 Album -> CLICK",
"[link] Show more\u2026 -> CLICK",
"[link] 1,342 2016 -> CLICK",
"[link] 98 \u00a315 - \u00a320 -> CLICK",
"[link] Condition -> CLICK",
"[link] Phil Collins - Both Sides (CD, Album, RE + CD + Dl... -> CLICK",
"[link] Add\u00a0to\u00a0Cart -> CLICK",
"[checkbox] I agree to Sales & Transaction Policy and Seller ... -> CLICK",
"[button] Place order and pay now -> CLICK"
]
},
{
"website": "budget",
"id": "6a9a2e52-24b4-46c3-9e52-0f79c15ae3d0",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Find a full-time job in Budget USA in finance in any location, and apply to the latest job.",
"action_reprs": [
"[link] Careers -> CLICK",
"[link] Openings -> CLICK",
"[button] Country -> CLICK",
"[searchbox] Search -> CLICK",
"[option] United States of America -> CLICK",
"[button] Team -> CLICK",
"[searchbox] Search -> CLICK",
"[option] Finance -> CLICK",
"[button] Time Type -> CLICK",
"[searchbox] Search -> CLICK",
"[option] Full time -> CLICK",
"[button] SEARCH BY JOB TITLE OR KEYWORD -> CLICK",
"[link] Accounts Payable Associate -> CLICK",
"[link] APPLY NOW -> CLICK"
]
},
{
"website": "budget",
"id": "7f0d7056-07f8-48b3-8093-e48abb301018",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "What is the cheapest luxury car to pickup on the second closest nearby location to New York, United States, 100",
"action_reprs": [
"[link] Luxury Car Rental -> CLICK",
"[textbox] Enter your pick-up location or zip code -> TYPE: New York, United States, 100",
"[textbox] Enter your pick-up location or zip code -> ENTER",
"[link] Close -> CLICK",
"[div] Sort by: -> CLICK",
"[link] Price (Low to High) -> CLICK"
]
},
{
"website": "budget",
"id": "87b23bf1-3c23-45a6-82bf-5a535c7cdc2f",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Book the cheapest long-term car rental with a fuel plan, GPS, and satellite radio from June 29 to July 28, pick up at 9 am at Orlando airport and dropping off at the same location.",
"action_reprs": [
"[link] Long-Term Car Rental -> CLICK",
"[textbox] Enter your pick-up location or zip code -> TYPE: orlando",
"[span] Orlando Intl Airport -> CLICK",
"[textbox] mm/dd/yyyy -> CLICK",
"[link] 29 -> CLICK",
"[link] 28 -> CLICK",
"[combobox] Pick Up Time -> SELECT: 9:00 AM",
"[combobox] Return Time -> SELECT: 9:00 AM",
"[button] Select My Car -> CLICK",
"[link] Recommended -> CLICK",
"[link] Price (Low to High) -> CLICK",
"[link] Pay Now -> CLICK",
"[checkbox] $16.99/Day$6.55/Day -> CLICK",
"[checkbox] $5.99/Day$1.38/Day -> CLICK",
"[checkbox] MARKET -> CLICK",
"[button] Continue -> CLICK"
]
},
{
"website": "resy",
"id": "f61456ed-3cc2-41a0-b79c-56737515fac9",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Open the photo gallery for Tsiakkos & Charcoal.",
"action_reprs": [
"[textbox] Search restaurants, cuisines, etc. -> TYPE: Tsiakkos & Charcoal",
"[heading] Tsiakkos & Charcoal -> CLICK",
"[button] View All (10) -> CLICK"
]
},
{
"website": "rottentomatoes",
"id": "0b2c1886-0345-4ca7-a555-8b1cd1b1c40a",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Browse certified fresh sci-fi films streaming at home.",
"action_reprs": [
"[link] MOVIES -> HOVER",
"[link] Certified fresh movies -> CLICK",
"[svg] -> CLICK",
"[div] -> CLICK",
"[button] APPLY -> CLICK"
]
},
{
"website": "rottentomatoes",
"id": "117c1176-b5bd-4b9a-9be2-80a7f390e207",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Find the US box office revenue for the highest tomatometer rated movie that the actress playing Sam Carpenter in the most recent Scream movie has been in.",
"action_reprs": [
"[textbox] Search -> TYPE: scream",
"[p] Neve Campbell, Courteney Cox, David Arquette -> CLICK",
"[link] Melissa Barrera -> CLICK",
"[link] In the Heights -> CLICK"
]
},
{
"website": "underarmour",
"id": "73cf6eec-cae6-4d5b-9b8e-e44359311565",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Sign up for the newsletter",
"action_reprs": [
"[textbox] Email Address * -> TYPE: larryknox@gmail.com",
"[button] Sign Up -> CLICK"
]
},
{
"website": "underarmour",
"id": "90bd64ec-d48e-4796-a4e2-c46b866093c2",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Search for newest girls' training leggings in size yxl and save the top three results.",
"action_reprs": [
"[menuitem] Kids -> HOVER",
"[menuitem] Pants & Leggings -> CLICK",
"[div] Sports -> CLICK",
"[link] Training -> CLICK",
"[div] Size -> CLICK",
"[link] YXL -> CLICK",
"[div] Size -> CLICK",
"[div] Sports -> CLICK",
"[div] Fit -> CLICK",
"[link] Fitted -> CLICK",
"[div] Size -> CLICK",
"[span] Now Trending -> CLICK",
"[li] Newest -> CLICK",
"[button] Add to Wish List -> CLICK",
"[button] Add to Wish List -> CLICK",
"[button] Add to Wish List -> CLICK"
]
},
{
"website": "kayak",
"id": "8dc49f67-4803-416a-8d05-d6e891e3efc0",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Get the hotel with highest review score having free internet and free cancelation in Chennai for 20/03/23",
"action_reprs": [
"[link] Search for hotels -> CLICK",
"[textbox] Enter a city, hotel, airport, address or landmark -> TYPE: Chennai",
"[option] Chennai, Tamil Nadu, India -> CLICK",
"[button] Monday March 20, 2023 -> CLICK",
"[button] Search -> CLICK",
"[svg] -> CLICK",
"[tab] Review score -> CLICK",
"[checkbox] Free internet -> CLICK",
"[checkbox] Free cancellation -> CLICK"
]
},
{
"website": "rottentomatoes",
"id": "60e7ffd3-dda8-4ec6-9c10-115a5ab1bf90",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Show me the latest news from rotten tomatoes.",
"action_reprs": [
"[link] NEWS -> HOVER",
"[link] VIEW ALL -> CLICK"
]
},
{
"website": "rottentomatoes",
"id": "867dc9d1-5017-4871-a52a-a1511f239628",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Browse movie trailers currently in theaters with \"fresh\" rating.",
"action_reprs": [
"[link] MOVIES -> HOVER",
"[link] Trailers -> CLICK",
"[link] VIEW ALL -> CLICK",
"[span] Tomatometer -> CLICK",
"[div] -> CLICK",
"[button] APPLY -> CLICK"
]
},
{
"website": "sports.yahoo",
"id": "ae969e05-d10e-4255-99f7-c27e071fad69",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Find the standings for the English Premier League.",
"action_reprs": [
"[div] \u2026 -> CLICK",
"[link] Soccer . -> CLICK",
"[link] Premier League -> HOVER",
"[link] Standings -> CLICK"
]
},
{
"website": "sports.yahoo",
"id": "b3a28e48-3912-4b0e-b3a9-d359da13864d",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Show me the NFL passing touchdown season stats.",
"action_reprs": [
"[link] NFL . -> HOVER",
"[link] Stats . -> CLICK",
"[link] Touchdowns -> CLICK"
]
},
{
"website": "sports.yahoo",
"id": "dd38e3f0-242c-4ef2-b4d9-bd13adc675b7",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Show me the page with download options for fantasy apps.",
"action_reprs": [
"[link] Fantasy . -> HOVER",
"[link] Download the App . -> CLICK"
]
},
{
"website": "sports.yahoo",
"id": "f45b0783-4325-4b3e-959d-c181971d72f6",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Search for the latest news and rumors about the NBA team the Los Angeles Lakers.",
"action_reprs": [
"[link] NBA . -> CLICK",
"[link] Teams -> CLICK",
"[link] Los Angeles Lakers -> CLICK"
]
},
{
"website": "spothero",
"id": "009cc066-87b2-4ebb-ad8f-41eeb3d94be6",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find a parking with EV charging for month with lowest price in Chicago.",
"action_reprs": [
"[tab] Monthly -> CLICK",
"[textbox] Search for parking -> TYPE: Chicago",
"[li] Chicago, IL, USA -> CLICK",
"[button] Filter -> CLICK",
"[checkbox] EV Charging (10) -> CLICK",
"[button] Show 10 Results -> CLICK",
"[select] Sort by Distance -> SELECT: Sort by Price",
"[button] View Details -> CLICK"
]
},
{
"website": "spothero",
"id": "04782cf5-acdf-4a9e-b3a6-4b51a18e5c28",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find an hourly parking in New York City of lowest price.",
"action_reprs": [
"[textbox] Search for parking -> TYPE: New York City",
"[li] New York City, NY, USA -> CLICK",
"[select] Sort by Distance -> SELECT: Sort by Price"
]
},
{
"website": "kayak",
"id": "6d5c4d19-c2cc-4e68-9f51-71ba6cd6e38a",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find a hotel with 4 star and above rating in Los Angeles for 3 days next week and save it.",
"action_reprs": [
"[link] Search for hotels -> CLICK",
"[textbox] Enter a city, hotel, airport, address or landmark -> TYPE: Los Angeles",
"[span] City -> CLICK",
"[div] 21 -> CLICK",
"[div] 23 -> CLICK",
"[path] -> CLICK",
"[div] 4 -> CLICK",
"[svg] -> CLICK"
]
},
{
"website": "kayak",
"id": "7c2ab1ed-54b7-4316-8b2f-d7467e01b540",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Get the cheapest direct flight from Madurai to Chennai on 20/3/23 booking through Air India.com",
"action_reprs": [
"[link] Search for flights -> CLICK",
"[textbox] Flight origin input -> TYPE: madurai",
"[div] Madurai, Tamil Nadu, India -> CLICK",
"[path] -> CLICK",
"[button] Search -> CLICK",
"[svg] -> CLICK",
"[label] Air India -> HOVER",
"[button] Air India only -> CLICK",
"[button] Cheapest -> CLICK"
]
},
{
"website": "imdb",
"id": "4bce534f-3057-40ca-aecd-ffb07b3c9fcb",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Search the actor who won the Oscars for best actor in a suuporing role ine 1990, and add his upcoming movies to my watchlist.",
"action_reprs": [
"[button] Open Navigation Drawer -> CLICK",
"[span] Oscars -> CLICK",
"[link] 1990 -> CLICK",
"[link] Denzel Washington -> CLICK",
"[button] Expand Upcoming -> CLICK",
"[button] add to watchlist -> CLICK",
"[button] add to watchlist -> CLICK"
]
},
{
"website": "imdb",
"id": "4ee87dc8-2fa1-4c98-828c-9c0c8dd8225f",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Edit my movie watchlist.",
"action_reprs": [
"[button] Watchlist5 -> CLICK",
"[link] EDIT -> CLICK"
]
},
{
"website": "imdb",
"id": "4f208b8b-6d5c-4d3f-8df0-cab24d29edda",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Find The Last of Us series and add it to my watch list.",
"action_reprs": [
"[textbox] Search IMDb -> TYPE: The Last of Us",
"[link] The Last of Us The Last of Us 2023 Pedro Pascal, B... -> CLICK",
"[div] Add to Watchlist -> CLICK"
]
},
{
"website": "imdb",
"id": "551ab381-5bfe-4491-9602-0b0c584d1346",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Give me the IMDB recommendations of what to watch.",
"action_reprs": [
"[button] Open Navigation Drawer -> CLICK",
"[span] What to Watch -> CLICK"
]
},
{
"website": "imdb",
"id": "55518089-52b9-4504-8e4f-885a9b2943a8",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Show me a list of comedy movies, sorted by user ratings.",
"action_reprs": [
"[button] Open Navigation Drawer -> CLICK",
"[span] Browse Movies by Genre -> CLICK",
"[img] Comedy -> CLICK",
"[link] User Rating -> CLICK"
]
},
{
"website": "bookdepository",
"id": "bd2b5866-dced-4ec1-8b3e-8a8a24e71a96",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Check all English Reading and Writing skills Educational Books for Ages 6-8 currently in stock that are available in hardback under 20$.",
"action_reprs": [
"[link] Shop by category\u2228 -> CLICK",
"[link] Shop by category\u2228 -> CLICK",
"[link] Ages 6-8 -> CLICK",
"[link] Education -> CLICK",
"[span] English Language -> CLICK",
"[link] English Language: Reading & Writing Skills -> CLICK",
"[select] All -> SELECT: In Stock (41,088)",
"[select] All -> SELECT: Hardback (13,067)",
"[select] All -> SELECT: Under US$20",
"[button] Refine results -> CLICK"
]
},
{
"website": "bookdepository",
"id": "c1a354a1-7990-4ca8-9fc5-2fdb1b5df337",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find a book in Hindi with ISBN 1648926800.",
"action_reprs": [
"[link] Advanced Search -> CLICK",
"[input] -> CLICK",
"[input] -> TYPE: 1648926800",
"[select] All -> SELECT: Hindi",
"[button] Search -> CLICK"
]
},
{
"website": "qatarairways",
"id": "b7cee0c0-b67d-46b8-bbd1-9f042fe810f5",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Retrieve booking for 123456 last name Smith.",
"action_reprs": [
"[tab] \ue90cMy Trips -> CLICK",
"[textbox] booking reference -> TYPE: 123456",
"[textbox] last name -> TYPE: Smith",
"[button] Retrieve booking -> CLICK"
]
},
{
"website": "ikea",
"id": "d78e3aac-c01b-4ebb-957d-e70f8bb378f3",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Open the design tool for a new home office.",
"action_reprs": [
"[link] Design -> CLICK",
"[p] Fresh Home Office -> CLICK"
]
},
{
"website": "kayak",
"id": "913b902b-37b7-4230-a0f2-a19931b06951",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find the fastest single stop flight fron JFK airport in New York to Male in Maldives on March 13",
"action_reprs": [
"[span] Round-trip -> CLICK",
"[tab] One-way -> CLICK",
"[textbox] Flight origin input -> TYPE: new york",
"[div] John F Kennedy Intl -> CLICK",
"[textbox] Flight destination input -> TYPE: male",
"[span] Mal\u00e9, Maldives -> CLICK",
"[button] Start date calendar input -> CLICK",
"[div] 13 -> CLICK",
"[button] Search -> CLICK",
"[div] -> CLICK",
"[div] Quickest -> CLICK"
]
},
{
"website": "kayak",
"id": "9ab66035-9569-4d5a-b1ca-09128cdd7456",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find the cheapest Hawaii package for two adults from June 18 to 21, and the hotel must be near a beach, have a beachfront, hot tub, and pool, and provides towels.",
"action_reprs": [
"[link] Search for packages -> CLICK",
"[link] Hawaii Vacations -> CLICK",
"[generic] Departure date input -> CLICK",
"[button] Next month -> CLICK",
"[gridcell] June 18 -> CLICK",
"[gridcell] June 21 -> CLICK",
"[button] Search packages -> CLICK",
"[button] Amenities -> CLICK",
"[checkbox] Beachfront -> CLICK",
"[checkbox] Hot tub -> CLICK",
"[checkbox] Pool -> CLICK",
"[checkbox] Towels -> CLICK",
"[button] Property style -> CLICK",
"[checkbox] Beach -> CLICK",
"[div] Recommended -> CLICK",
"[tab] Price (low to high) -> CLICK",
"[div] View Deal -> CLICK",
"[button] Next: Final details -> CLICK"
]
},
{
"website": "resy",
"id": "4b33554f-eb29-4f8d-93cf-5e947e4f8e47",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Search for restaurants near my location with pizza and for 6 customers.",
"action_reprs": [
"[textbox] Search restaurants, cuisines, etc. -> TYPE: Pizza",
"[b] Pizza -> CLICK",
"[combobox] Party of 2 -> SELECT: 6 Guests"
]
},
{
"website": "resy",
"id": "51b75f3d-b293-495d-a5a0-8ed5cc8270a2",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Make a reservation for 2 guests on april 21 at noon in a restaurant in Austin that is new on resy",
"action_reprs": [
"[path] -> CLICK",
"[button] Austin -> CLICK",
"[heading] New On Resy -> CLICK",
"[button] Sat., Apr. 22 -> CLICK",
"[button] April 21, 2023. -> CLICK",
"[combobox] Party of 2 -> SELECT: 2 Guests",
"[link] Este -> CLICK",
"[button] 12:00 PM Dining -> CLICK",
"[button] Reserve Now -> CLICK"
]
},
{
"website": "resy",
"id": "5f09e15c-c987-4bdb-ab6e-5db39b18317d",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Book 3 tickets for a Special Event or Experience in Miami on may 4",
"action_reprs": [
"[svg] -> CLICK",
"[button] Miami -> CLICK",
"[textbox] Search restaurants, cuisines, etc. -> CLICK",
"[button] View all Miami Restaurants \u203a -> CLICK",
"[path] -> CLICK",
"[link] Thursday, May 4th | American Express Presents CARB... -> CLICK",
"[combobox] 2 tickets for Thursday, May 4th | American Express... -> SELECT: 3 Tickets",
"[button] Book Now a ticket for Centurion\u00ae Member Access to ... -> CLICK",
"[button] Reserve Now -> CLICK"
]
},
{
"website": "last.fm",
"id": "0cb50efe-4568-4c8d-bf0e-ed106cf99d1d",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Find the all time most popular solo track by ArianaGrande",
"action_reprs": [
"[link] Search -> CLICK",
"[textbox] Search -> TYPE: Ariana Grande",
"[button] Search -> CLICK",
"[a] -> CLICK",
"[button] Sorted by: Last 7 days -> CLICK",
"[link] All time -> CLICK",
"[gridcell] 7 rings -> CLICK"
]
},
{
"website": "last.fm",
"id": "1d738d01-507e-46ff-8d4d-d4a7dffed936",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Find the weekly chart-topper artist and play the number 1 track of that artist after liking the track.",
"action_reprs": [
"[link] Charts -> CLICK",
"[link] Weekly -> CLICK",
"[link] The Weeknd -> CLICK",
"[button] Love this track -> CLICK",
"[link] Play track -> CLICK"
]
},
{
"website": "budget",
"id": "593830ff-fd2c-4479-abf8-8fddee2cdaea",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Show brochure of Loss Damage Waiver Protection.",
"action_reprs": [
"[button] Cars & Services -> CLICK",
"[link] Products & Services -> CLICK",
"[div] Learn More -> CLICK",
"[div] Learn More -> CLICK",
"[link] click here -> HOVER"
]
},
{
"website": "budget",
"id": "66625c9d-5bf3-42d1-b463-ab2767307201",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Learn more about the Partner Deal that gives 25% off for Veterans.",
"action_reprs": [
"[button] Deals -> CLICK",
"[link] Partner Deals -> CLICK",
"[button] Learn More -> CLICK"
]
},
{
"website": "budget",
"id": "694f3b5c-8ee4-45c1-bb7c-b5377c366096",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Select the mystery vehicle to pick up at Bradenton in Mahattan, Florida on april 20 at 3 pm and return at 6pm",
"action_reprs": [
"[textbox] Enter your pick-up location or zip code -> TYPE: Manhattan",
"[div] Manhattan -> CLICK",
"[textbox] mm/dd/yyyy -> CLICK",
"[link] 20 -> CLICK",
"[link] 20 -> CLICK",
"[combobox] Pick Up Time -> SELECT: 3:00 PM",
"[combobox] Return Time -> SELECT: 6:00 PM",
"[button] Select My Car -> CLICK",
"[link] Close -> CLICK",
"[link] Pay Now -> CLICK"
]
},
{
"website": "sixflags",
"id": "c3e841d5-4624-44cb-a8b5-897b9aa3ef9b",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Buy a single day pass to Six Flags, Magic Mountain.",
"action_reprs": [
"[button] Browse the Parks Below -> CLICK",
"[span] Six Flags Magic Mountain -> CLICK",
"[button] Go! -> CLICK",
"[link] Tickets, Passes, VIP Tours \uf078 -> CLICK",
"[link] Tickets & Passes -> CLICK",
"[span] Buy Now > -> CLICK",
"[button] Buy Now -> CLICK",
"[button] Add to Cart -> CLICK",
"[button] No Thanks -> CLICK",
"[button] No Thanks, Continue -> CLICK"
]
},
{
"website": "sixflags",
"id": "c4538b84-ca81-413a-8f3d-7ce87e42b4f6",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find the Saturday park hours for Six Flags, Magic Mountain.",
"action_reprs": [
"[button] Browse the Parks Below -> CLICK",
"[span] Six Flags Magic Mountain -> CLICK",
"[button] Go! -> CLICK",
"[link] Park Hours & Calendar \ue901 Closed Today -> CLICK"
]
},
{
"website": "sixflags",
"id": "caafd610-202e-49d2-85d1-3f167f3ab443",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Show me the map of a Six flags park in mexico",
"action_reprs": [
"[button] Browse the Parks Below -> CLICK",
"[span] Six Flags M\u00e9xico -> CLICK",
"[button] Go! -> CLICK",
"[link] Planea Tu Visita \uf078 -> CLICK",
"[link] Mapa del Parque -> CLICK"
]
},
{
"website": "resy",
"id": "1bb8d48f-dac7-472d-b2b2-651ab184baf2",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Look for a hybrid job at Resy in software development, if the job is open apply immediately.",
"action_reprs": [
"[link] Careers -> CLICK",
"[link] View All Open Positions -> CLICK",
"[span] Filters -> CLICK",
"[a] Software Development -> CLICK",
"[a] Hybrid -> CLICK",
"[i] -> CLICK",
"[button] Apply Now -> CLICK",
"[button] NEXT -> CLICK"
]
},
{
"website": "resy",
"id": "3596733f-6427-4ab5-9ff1-c65baaf524f1",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Show the list of restaurants with reservations available for 04/11 with vegetarian food.",
"action_reprs": [
"[textbox] Search restaurants, cuisines, etc. -> TYPE: vegetarian",
"[b] Vegetarian -> CLICK",
"[button] Fri., Apr. 14 -> CLICK",
"[button] April 11, 2023. -> CLICK"
]
},
{
"website": "resy",
"id": "3eae65d9-7778-4cf2-bc3d-f666b5e43bce",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Notify me about availability for 2 guests on april 17 at the High Tide restaurant",
"action_reprs": [
"[textbox] Search restaurants, cuisines, etc. -> TYPE: high tide",
"[heading] High Tide -> CLICK",
"[div] Fri., Apr. 21 -> CLICK",
"[button] April 17, 2023. -> CLICK",
"[combobox] Guests -> SELECT: 2 Guests",
"[button] Notify for Lunch -> CLICK"
]
},
{
"website": "resy",
"id": "4a4ecf18-e7a3-448a-b8cb-b337ee20048d",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Book a table for 3 in Los angeles for diner at 09 PM on Mar 10",
"action_reprs": [
"[svg] -> CLICK",
"[button] Los Angeles -> CLICK",
"[textbox] Search restaurants, cuisines, etc. -> TYPE: diner",
"[heading] Spiral Diner & Bakery - Fort Worth -> CLICK",
"[combobox] Guests -> SELECT: 3 Guests",
"[div] Today -> CLICK",
"[button] March 10, 2023. -> CLICK",
"[button] 9:00 PM Dining Room -> CLICK"
]
},
{
"website": "tesla",
"id": "642ac4f9-dea1-4c10-89a5-208238a2c6e9",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Find a red used tesla Model S.",
"action_reprs": [
"[link] Model S -> CLICK",
"[link] View Inventory -> CLICK",
"[radio] Used -> CLICK",
"[image] -> CLICK"
]
},
{
"website": "rentalcars",
"id": "d9ab19b6-fecb-4545-ab5d-fabc94c27ff6",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Hire a premium luxury car closest to North Las Vegas on April 29 at 6 pm and drop it off at the same location and the same day at 11 pm, supplier should be Avis if available.",
"action_reprs": [
"[svg] -> CLICK",
"[link] Luxury Car Rental -> CLICK",
"[label] Pick-up location -> TYPE: north las vegas",
"[div] North Las Vegas -> CLICK",
"[div] Thu, Apr 20 -> CLICK",
"[checkbox] 29 April 2023 -> CLICK",
"[checkbox] 29 April 2023 -> CLICK",
"[combobox] Pick up time -> SELECT: 6:00 PM",
"[combobox] Drop off time -> SELECT: 11:00 PM",
"[div] Search -> CLICK",
"[div] Premium -> CLICK",
"[label] Distance -> CLICK",
"[svg] -> CLICK",
"[span] -> CLICK",
"[div] View deal -> CLICK",
"[span] Go to book -> CLICK"
]
},
{
"website": "soundcloud",
"id": "973bf55c-d1a0-41c7-9ec8-9f59b3dbfb58",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Repost on my feed a rock playlist.",
"action_reprs": [
"[searchbox] Search -> TYPE: rock",
"[button] Search -> CLICK",
"[link] Playlists -> CLICK",
"[button] Repost -> CLICK"
]
},
{
"website": "soundcloud",
"id": "978760ca-7ec3-4b78-86c6-98b173c1a00e",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Follow an artist from the chill category.",
"action_reprs": [
"[searchbox] Search -> TYPE: Chill",
"[button] Search -> CLICK",
"[link] People -> CLICK",
"[button] Follow -> CLICK"
]
},
{
"website": "cargurus",
"id": "c44cfc8c-abea-4eef-838a-ba3a2716f8fa",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "calculate a car loan payment for a $25000 car with a $5000 down payment and 12 percent interest rate for 48 months.",
"action_reprs": [
"[menuitem] Finance -> HOVER",
"[menuitem] Loan Calculator -> CLICK",
"[input] -> TYPE: 25000",
"[input] -> TYPE: 5000",
"[input] -> TYPE: 12",
"[label] 48 mo -> CLICK"
]
},
{
"website": "cargurus",
"id": "cc643c1f-e73e-4e9f-abe9-5ee2d3b0a0dd",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Check the lowest price for a white 2017 certified pre owned Lexus Rx350 near 90012.",
"action_reprs": [
"[LabelText] Certified Pre-Owned -> CLICK",
"[combobox] Select Make -> SELECT: Lexus",
"[combobox] Select Model -> SELECT: RX",
"[textbox] Zip -> TYPE: 90012",
"[button] Search -> CLICK",
"[combobox] Select Minimum Year -> SELECT: 2017",
"[combobox] Select Maximum Year -> SELECT: 2017",
"[div] White -> CLICK",
"[combobox] Select Sort Order -> SELECT: Lowest price first"
]
},
{
"website": "uniqlo",
"id": "ccf98191-100e-441a-93e8-8ff4076aeaa0",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Add to my cart a women's T-shirt priced under 10 dollars",
"action_reprs": [
"[link] WOMEN -> HOVER",
"[tab] Tops -> CLICK",
"[link] T-Shirts -> CLICK",
"[heading] Price -> CLICK",
"[label] $0-$10 -> CLICK",
"[polygon] -> CLICK",
"[heading] Mini Short-Sleeve T-Shirt -> CLICK",
"[button] ADD TO CART -> CLICK"
]
},
{
"website": "foxsports",
"id": "fce75183-0825-42b1-baf3-a9214fe20ce9",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Browse recent NFL-related videos.",
"action_reprs": [
"[link] National Football League NFL -> CLICK",
"[heading] VIDEOS -> CLICK"
]
},
{
"website": "gamestop",
"id": "000c2828-e8ce-4b18-bfe0-89ed333add06",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Buy a $25 digital gift card for Tim Stebee, whose email address is scisoorbros@gmail.com. Fill in sender name Jeerimiah Waton",
"action_reprs": [
"[img] -> CLICK",
"[img] GameStop Digital Gift Cards -> CLICK",
"[textbox] Recipient Name -> TYPE: Tim Stebee",
"[textbox] Recipient Email -> TYPE: scisoorbros@gmail.com",
"[textbox] Sender Name -> TYPE: Jeerimiah Waton",
"[button] ADD TO CART -> CLICK"
]
},
{
"website": "gamestop",
"id": "13cf0b14-422b-4486-841a-aa9ded048380",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "find kinect camera for xbox one.",
"action_reprs": [
"[searchbox] Search games, consoles & more -> TYPE: kinect camera",
"[button] Search -> CLICK",
"[img] -> CLICK"
]
},
{
"website": "gamestop",
"id": "1a2befd0-5e90-4bed-81b5-8ee0a93873df",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Show me RPG video games.",
"action_reprs": [
"[button] Main Menu -> CLICK",
"[button] Video Games chevron_right -> CLICK",
"[button] Shop all -> CLICK",
"[link] Filter -> CLICK",
"[button] Genre -> CLICK",
"[link] View More -> CLICK",
"[checkbox] RPG RPG -> CLICK",
"[button] Done -> CLICK"
]
},
{
"website": "yelp",
"id": "da386775-280b-4a84-9801-4ae3098044b0",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Find parking in California city for Limos which also offers military discounts and free wi-fi.",
"action_reprs": [
"[link] Auto Services -> HOVER",
"[span] Parking -> CLICK",
"[textbox] Near -> TYPE: CALIFORNIA",
"[span] California -> CLICK",
"[button] Limos -> CLICK",
"[checkbox] Offers Military Discount -> CLICK",
"[checkbox] Free Wi-Fi -> CLICK"
]
},
{
"website": "qatarairways",
"id": "b28e6a37-6e9c-46bb-8012-18ca742a521f",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Explore Durban in Africa and book a flight from Doha for 2 adults and 1 infant, on May 28, book the first flight in economy comfort.",
"action_reprs": [
"[button] Explore (current) -> CLICK",
"[link] Africa 29 -> CLICK",
"[div] Durban -> CLICK",
"[link] Discover -> CLICK",
"[textbox] From Autocomplete selection. Enter your place. -> TYPE: doha",
"[strong] Doha -> CLICK",
"[textbox] Depart date please enter date in the format dd spa... -> CLICK",
"[gridcell] 28 May 2023 -> CLICK",
"[button] Continue -> CLICK",
"[textbox] Passengers / Class -> CLICK",
"[button] Increase number of infant passengers -> CLICK",
"[button] Confirm -> CLICK",
"[button] Show flights\ue99a -> CLICK",
"[heading] QAR\u00a04,980 -> CLICK",
"[button] Select fare -> CLICK"
]
},
{
"website": "imdb",
"id": "5a181549-c79c-499c-b7d7-90860f0e0068",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Play Trailer of \"The Flash\" 2023.",
"action_reprs": [
"[textbox] Search IMDb -> CLICK",
"[textbox] Search IMDb -> TYPE: The Flash",
"[div] The Flash -> CLICK",
"[generic] Watch Official Trailer -> CLICK"
]
},
{
"website": "united",
"id": "112459f9-10ea-44b5-affa-79008c2977e7",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Browse check in with confirmation number 123456 for John.",
"action_reprs": [
"[heading] Check-in -> CLICK",
"[textbox] Confirmation or ticket number* -> TYPE: 123456",
"[textbox] Last name* -> TYPE: John",
"[button] Search -> CLICK"
]
},
{
"website": "eventbrite",
"id": "ee22220c-802b-431f-abb4-0131fd8dbe5f",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Get 2 tickets for a free pet festival in English in Portland on april 15 to april 16",
"action_reprs": [
"[div] Search for events -> CLICK",
"[textbox] Search events -> TYPE: pet festival",
"[generic] Run Search -> CLICK",
"[label] -> CLICK",
"[label] -> CLICK",
"[label] -> CLICK",
"[combobox] autocomplete -> TYPE: portland",
"[div] Portland -> CLICK",
"[span] Pick a date... -> CLICK",
"[button] 15 -> CLICK",
"[button] 16 -> CLICK",
"[div] Petaluma Music Festival -> CLICK",
"[button] Get tickets -> CLICK",
"[listbox] Select quantity: General Admission price: $60.00 -> SELECT: 2",
"[button] Check out -> CLICK"
]
},
{
"website": "eventbrite",
"id": "fb7741f6-f388-4535-903d-d07315ea995e",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Find fitness events for this weekend.",
"action_reprs": [
"[link] Sports & Fitness -> CLICK",
"[svg] -> CLICK",
"[div] This weekend -> CLICK"
]
},
{
"website": "expedia",
"id": "1337eca1-4ca6-4102-964e-e7f6ecebcd0b",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Find things to do in Singapore on April 2 that are family friendly and offer free cancellation",
"action_reprs": [
"[tab] Things to do -> CLICK",
"[textbox] Things to do in -> TYPE: singapore",
"[button] Singapore Singapore -> CLICK",
"[button] From April 5, 2023 -> CLICK",
"[button] Apr 2, 2023 -> CLICK",
"[button] Apr 2, 2023 selected, current check in date. -> CLICK",
"[button] Done : (Save changes and close the date picker.) -> CLICK",
"[button] Search -> CLICK",
"[checkbox] Free cancellation -> CLICK",
"[checkbox] Family friendly -> CLICK"
]
},
{
"website": "us.megabus",
"id": "f464de6d-9923-4e8e-8046-56751a90a9a8",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Track a bus leaving from Abbotsford.",
"action_reprs": [
"[button] Check my bus\ue911 -> CLICK",
"[link] Track my bus -> CLICK",
"[combobox] From -> TYPE: Abbotsford",
"[div] Abbotsford -> CLICK",
"[button] Find my bus -> CLICK",
"[div] WCL3 -> CLICK"
]
},
{
"website": "cabelas",
"id": "619ba95b-5a27-4c53-841c-edc281aacf7a",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Add a dome tent to my shopping cart.",
"action_reprs": [
"[link] Camping -> CLICK",
"[menuitem] View All -> CLICK",
"[div] Type -> CLICK",
"[label] Dome -> CLICK",
"[link] Bass Pro Shops Eclipse 2-Person 5x7 Dome Tent -> CLICK",
"[button] ADD TO CART -> CLICK"
]
},
{
"website": "rentalcars",
"id": "e8ce2bcd-894d-4b2f-99e4-ae695a6b9dd9",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Find cheapest cars available at San Francisco Airport for a day.",
"action_reprs": [
"[link] San Francisco Airport -> CLICK",
"[div] Fri, Mar 31 -> CLICK",
"[checkbox] 29 March 2023 -> CLICK",
"[div] Search -> CLICK",
"[label] Price (lowest first) -> CLICK"
]
},
{
"website": "rentalcars",
"id": "f17fa68b-27dd-4b9c-bc11-7a5dbe206741",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Search for Premium Cars available to rent at LondonHeathrow Airport.",
"action_reprs": [
"[label] Pick-up location -> CLICK",
"[textbox] Pick-up location -> TYPE: London",
"[div] London Heathrow Airport (LHR) -> CLICK",
"[div] Search -> CLICK",
"[img] -> CLICK"
]
},
{
"website": "resy",
"id": "126b4604-8b04-4eb1-9027-266631c96f01",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Book an outdoor table for 3 people at a Los Angeles restaurant for 5:00 PM on April 7th",
"action_reprs": [
"[button] Los Angeles -> CLICK",
"[link] La Cha Cha Cha -> CLICK",
"[div] Today -> CLICK",
"[button] April 7, 2023. -> CLICK",
"[combobox] Guests -> SELECT: 3 Guests",
"[button] 5:00 PM Outdoor Table -> CLICK",
"[button] Reserve Now -> CLICK"
]
},
{
"website": "resy",
"id": "164cf025-e767-4781-930d-5bd46ad2c4c1",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "What are the Resy Staff Favorites in Seattle?",
"action_reprs": [
"[button] Location Atlanta -> CLICK",
"[button] Seattle -> CLICK",
"[textbox] Search restaurants, cuisines, etc. -> CLICK",
"[link] Staff Picks -> CLICK"
]
},
{
"website": "imdb",
"id": "78c52592-76e4-4c45-afd5-f94cf213314e",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Play a star wars movie trailer.",
"action_reprs": [
"[textbox] Search IMDb -> TYPE: Star Wars",
"[button] Submit Search -> CLICK",
"[button] Star Wars: Episode IV - A New Hope -> CLICK",
"[generic] Watch Original Teaser Trailer -> CLICK"
]
},
{
"website": "imdb",
"id": "81fb481b-a234-4e25-b494-9ed26a03e977",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Add the second most popular horror series to my watchlist.",
"action_reprs": [
"[path] -> CLICK",
"[span] Most Popular TV Shows -> CLICK",
"[link] Horror -> CLICK",
"[generic] Click to add to watchlist -> CLICK"
]
},
{
"website": "imdb",
"id": "9e3786bf-56a4-4b4a-a94e-a4c1620cd0b2",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Find videos from the Oscar 2023.",
"action_reprs": [
"[button] Open Navigation Drawer -> CLICK",
"[span] Oscars -> CLICK",
"[link] VIDEO -> CLICK"
]
},
{
"website": "imdb",
"id": "a6080a77-ec5d-44d6-a51e-0b4ca0d50879",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Find the list of critic reviews for the movie Creed III.",
"action_reprs": [
"[textbox] Search IMDb -> TYPE: creed III",
"[div] Creed III -> CLICK",
"[span] Critic reviews -> CLICK"
]
},
{
"website": "imdb",
"id": "db53ba89-9cff-441a-a703-053e89e32961",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Find superhero sci-fi movies based on comic books rated 7 to 9, and add the three movies with the most votes to my watchlist.",
"action_reprs": [
"[path] -> CLICK",
"[span] Browse Movies by Genre -> CLICK",
"[link] Superhero -> CLICK",
"[checkbox] Superhero Sci Fi (745) -> CLICK",
"[checkbox] Based On Comic Book (226) -> CLICK",
"[strong] IMDb Rating -> CLICK",
"[group] IMDb user rating (average) -> SELECT: 7.0",
"[group] IMDb user rating (average) -> SELECT: 9.0",
"[strong] Refine -> CLICK",
"[select] Popularity -> SELECT: Number of Votes",
"[generic] Compact view -> CLICK",
"[generic] Click to add to watchlist -> CLICK",
"[generic] Click to add to watchlist -> CLICK",
"[generic] Click to add to watchlist -> CLICK"
]
},
{
"website": "kayak",
"id": "f8027aa8-c193-47c8-a97b-432836093939",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find hotels in Las Vegas, NV that offer free airport shuttle service.",
"action_reprs": [
"[link] Search for hotels -> CLICK",
"[textbox] Enter a city, hotel, airport, address or landmark -> CLICK",
"[textbox] Enter a city, hotel, airport, address or landmark -> TYPE: Las Vegas",
"[span] Las Vegas, Nevada, United States -> CLICK",
"[svg] -> CLICK",
"[checkbox] Free airport shuttle -> CLICK"
]
},
{
"website": "kbb",
"id": "3d77584f-9074-46db-bd1e-086a506b54d3",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Search for the cheapest third-party certified front-wheel driving automatic white car for sale near Tampa, Florida with online paperwork and no accidents, confirm availability with my details.",
"action_reprs": [
"[polyline] -> CLICK",
"[link] Cars for sale near Tampa, FL -> CLICK",
"[checkbox] Third-Party Certified (343)\uf05a -> CLICK",
"[span] Drive Type -> CLICK",
"[checkbox] Front Wheel Drive (147) -> CLICK",
"[span] Exterior Color -> CLICK",
"[div] -> CLICK",
"[checkbox] Online Paperwork (4)\uf05a -> CLICK",
"[span] Vehicle History -> CLICK",
"[checkbox] No Accidents (4) -> CLICK",
"[combobox] Sort By: -> SELECT: Price - Lowest",
"[link] Confirm Availability for Used 2019 Buick Encore Pr... -> CLICK",
"[textbox] First Name -> TYPE: James",
"[textbox] Last Name -> TYPE: Smith",
"[button] Send Email -> CLICK"
]
},
{
"website": "sixflags",
"id": "dc1f0824-5483-4d3b-87d2-3f760a42a25e",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Show me all the events at any six flags park in Texas",
"action_reprs": [
"[button] Browse the Parks Below -> CLICK",
"[span] Six Flags Fiesta Texas -> CLICK",
"[button] Go! -> CLICK",
"[link] Events \uf078 -> CLICK",
"[link] See all events \uf054 -> CLICK"
]
},
{
"website": "sixflags",
"id": "df73be67-e81a-444f-82cc-e69d54a72734",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Show me the gift shops available at a park in New York",
"action_reprs": [
"[button] Browse the Parks Below -> CLICK",
"[span] Six Flags Darien Lake -> CLICK",
"[button] Go! -> CLICK",
"[link] Rides & Experiences \uf078 -> CLICK",
"[link] Shops & Gifts -> CLICK",
"[select] All Shops -> SELECT: Gifts"
]
},
{
"website": "last.fm",
"id": "6df317e6-3414-4f2e-b5fc-b70914def4eb",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Show Jazz music genre albums and tracks.",
"action_reprs": [
"[link] Music -> CLICK",
"[link] jazz -> CLICK",
"[link] More tracks -> CLICK"
]
},
{
"website": "menards",
"id": "1bd729e8-abb2-4649-bb81-8c790c04f8ad",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find a multi-purpose painting tool available for pick up at zip 44240, if the brand Red Devil is available, add the cheapest one to the wishlist and view my complete wish list.",
"action_reprs": [
"[button] Departments -> CLICK",
"[button] Paint -> CLICK",
"[link] Painting Tools -> CLICK",
"[button] 43229 -> TYPE: 44240",
"[button] UPDATE -> CLICK",
"[checkbox] Pickup at Store Eligible (86) -> CLICK",
"[checkbox] Multi-Purpose Tool (11) -> CLICK",
"[checkbox] Red Devil (2) -> CLICK",
"[label] Add -> CLICK",
"[combobox] Select a list -> SELECT: Wish List",
"[link] VIEW YOUR LIST -> CLICK"
]
},
{
"website": "menards",
"id": "e224beac-a998-41e4-abd1-5370196ce9df",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Look for the cheapest led smart home indoor strip lighting, add it to the cart, and schedule the delivery.",
"action_reprs": [
"[button] Departments -> HOVER",
"[button] Electrical -> HOVER",
"[link] Smart Home -> CLICK",
"[link] Smart Lighting -> CLICK",
"[button] Indoor Lighting (7) -> CLICK",
"[checkbox] Strip Light (3) -> CLICK",
"[button] Sort By: Best Match -> CLICK",
"[button] Price Low to High -> CLICK",
"[button] ADD TO CART -> CLICK",
"[button] VIEW CART -> CLICK",
"[label] Select -> CLICK"
]
},
{
"website": "store.steampowered",
"id": "b4a2fc25-a7fe-4e31-beae-b31f2ef8cf3e",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Open the list of games I've played recently.",
"action_reprs": [
"[link] BUCKEYE.FOOBAR -> HOVER",
"[link] GAMES -> CLICK",
"[link] Recently Played (0) -> CLICK"
]
},
{
"website": "store.steampowered",
"id": "cd92cea9-a60f-4e09-90d7-32384ccdd61c",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Show most played games based on daily players.",
"action_reprs": [
"[link] New & Noteworthy -> HOVER",
"[link] Most Played -> CLICK",
"[generic] By Current Players -> CLICK",
"[div] By Daily Players -> CLICK"
]
},
{
"website": "store.steampowered",
"id": "d29fd2a4-2305-4276-8a0e-2599291d0a17",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Open the list of reviews I wrote about my games.",
"action_reprs": [
"[link] BUCKEYE.FOOBAR -> HOVER",
"[link] GAMES -> CLICK",
"[link] Reviews -> CLICK"
]
},
{
"website": "store.steampowered",
"id": "fc8342f9-3e2e-4f59-b54e-b35cd7285fdb",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Purchase the classic bundle for the simulation game Cities Skylines.",
"action_reprs": [
"[link] Categories -> HOVER",
"[link] Simulation -> CLICK",
"[link] CITIES: SKYLINES -> CLICK",
"[link] Bundle info -> CLICK",
"[link] Add to Cart -> CLICK",
"[link] Purchase for myself -> CLICK"
]
},
{
"website": "amtrak",
"id": "66a5b212-cf94-4917-8015-58970dc54187",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Show me the amtrak national route map",
"action_reprs": [
"[button] DESTINATIONS -> CLICK",
"[link] \uf18a SEE ALL ROUTES -> CLICK",
"[link] AMTRAK NATIONAL ROUTE MAP (PDF, 3MB) -> CLICK"
]
},
{
"website": "amtrak",
"id": "8cb94647-b0a8-4b8c-b00a-4788ef522b79",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find trains from New York to Washington DC leaving on april 18 for 2 adults with disability",
"action_reprs": [
"[textbox] From -> CLICK",
"[option] New York, NY - Moynihan Train Hall (NYP) -> CLICK",
"[textbox] To -> CLICK",
"[option] Washington, DC - Union Station (WAS) -> CLICK",
"[textbox] Depart Date -> CLICK",
"[gridcell] Tuesday, April 18, 2023 -> CLICK",
"[img] Add travelers and discounts -> CLICK",
"[button] + -> CLICK",
"[button] Apply Filters -> CLICK",
"[checkbox] Passenger with Disability or Assistance Needed? -> CLICK",
"[button] FIND TRAINS -> CLICK"
]
},
{
"website": "rei",
"id": "09675529-c12d-42dc-a260-c1e046f87256",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Trade in a Nemo Front Porch 2P Tent via mail with my membership info Joe Bloggs, phone number 123456789",
"action_reprs": [
"[link] Trade In -> CLICK",
"[link] Trade in by mail -> CLICK",
"[combobox] search input -> TYPE: Nemo Front Porch 2P Tent",
"[img] search icon -> CLICK",
"[button] Trade in -> CLICK",
"[link] Complete trade-in -> CLICK",
"[button] Verify membership to continue -> CLICK",
"[input] -> TYPE: Joe",
"[input] -> TYPE: Bloggs",
"[input] -> TYPE: 123456789",
"[button] Proceed to checkout -> CLICK"
]
},
{
"website": "rei",
"id": "0ff1648e-28bb-4014-9b8a-3c050c25e334",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Browse the women's hiking boots section and filter the results to show only those that are waterproof and have a rating of at least 4 stars and size 6.",
"action_reprs": [
"[button] Camp & Hike -> HOVER",
"[link] Women's -> CLICK",
"[link] add filter: 6(220) -> CLICK",
"[link] add filter: Waterproof(171) -> CLICK",
"[link] add filter: rating of 4-to-5 stars 99 -> CLICK"
]
},
{
"website": "amctheatres",
"id": "2cdee3d3-54d9-4f55-a8de-79ba9e2da28c",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Find theaters for Creed III within 20 miles of zip code 90028.",
"action_reprs": [
"[img] movie poster for Creed III -> CLICK",
"[link] get tickets for Creed III -> CLICK",
"[select] AMC Columbus 10 -> SELECT: Change Location...",
"[textbox] Search by City, Zip or Theatre -> TYPE: 90028",
"[generic] Submit Search -> CLICK"
]
},
{
"website": "amctheatres",
"id": "330d5618-9db4-447b-9b56-0d2c33f414d5",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Show me the full menu for AMC dine-in locations.",
"action_reprs": [
"[link] Visit the Food & Drinks page -> CLICK",
"[link] Explore Menu -> CLICK",
"[link] View Full Menu -> CLICK"
]
},
{
"website": "amctheatres",
"id": "36ab5d78-2f6b-47a6-ad88-3f6c8fdc3513",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Show me the movies playing today at the theater closest to zip code 10001",
"action_reprs": [
"[link] Visit the Our Theatres page -> CLICK",
"[link] Find a Theatre -> CLICK",
"[textbox] Find A Theatre -> TYPE: 10001",
"[generic] Submit Search -> CLICK",
"[link] Showtimes -> CLICK"
]
},
{
"website": "amctheatres",
"id": "66d12284-5525-42d2-a66f-fe5c460b7764",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Order popcorn at AMC Grove City 14",
"action_reprs": [
"[link] Visit the Food & Drinks page -> HOVER",
"[link] Order Food & Drinks -> CLICK",
"[select] AMC Columbus 10 -> SELECT: AMC Grove City 14",
"[button] Order Now -> CLICK",
"[img] -> CLICK",
"[button] Select -> CLICK",
"[div] -> CLICK",
"[button] Add to Order -> CLICK"
]
},
{
"website": "amctheatres",
"id": "6b831239-435b-494e-9aa8-a49e8605d0b3",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "What is trending now on AMC on-demand?",
"action_reprs": [
"[link] Visit the On Demand page -> HOVER",
"[link] Now Trending -> CLICK"
]
},
{
"website": "amctheatres",
"id": "779cec8e-eef5-4de8-a42e-b449363664df",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Find a theatre near 10001",
"action_reprs": [
"[link] Visit the Our Theatres page -> CLICK",
"[textbox] Find A Theatre -> TYPE: 10001",
"[generic] Submit Search -> CLICK"
]
},
{
"website": "amctheatres",
"id": "90557510-32dc-415f-8507-41b050594962",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Show me the coming soon AMC Artisan Films",
"action_reprs": [
"[link] Visit the See A Movie page -> CLICK",
"[link] Coming Soon -> CLICK",
"[combobox] Featured Movies -> SELECT: AMC Artisan Films"
]
},
{
"website": "amctheatres",
"id": "cfaa49bd-7943-4da8-ae5f-bb3a15dfaa05",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Find showtimes for John Wick 4 at a theater in Wichita, Kansas 67226",
"action_reprs": [
"[link] Visit the Our Theatres page -> CLICK",
"[link] Find a Theatre -> CLICK",
"[link] Wichita -> CLICK",
"[link] Showtimes -> CLICK",
"[heading] John Wick: Chapter 4 -> CLICK",
"[link] get tickets for John Wick: Chapter 4 -> CLICK"
]
},
{
"website": "sixflags",
"id": "e0feee24-dfed-454a-aa40-eda244f1d044",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Show the balance sheet and cash flow statement for the fiscal year 2021 of Six Flags.",
"action_reprs": [
"[link] Investors -> CLICK",
"[link] Financial Info -> CLICK",
"[heading] Balance Sheet -> CLICK",
"[link] Cash Flow -> CLICK"
]
},
{
"website": "ikea",
"id": "f118238f-ef8f-4b63-9159-a81e981ef46e",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Add decorative LED Candles to the cart.",
"action_reprs": [
"[link] Products -> CLICK",
"[button] Lighting -> CLICK",
"[link] Decorative lighting -> CLICK",
"[img] LED candles -> CLICK",
"[img] -> CLICK",
"[span] Add to bag -> HOVER"
]
},
{
"website": "ikea",
"id": "ff173880-e7f5-4b4e-b941-79e9c3504add",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find wall mirrors for under $20.",
"action_reprs": [
"[link] Products -> CLICK",
"[button] Home d\u00e9cor -> CLICK",
"[link] Mirrors -> CLICK",
"[link] Wall mirrors -> CLICK",
"[button] Show more filters modal -> CLICK",
"[span] Price -> CLICK",
"[span] -> CLICK",
"[span] View -> CLICK"
]
},
{
"website": "imdb",
"id": "265cd715-0607-4ebe-8420-046b1a165239",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "What are Jerry Trainor's upcoming projects?",
"action_reprs": [
"[textbox] Search IMDb -> TYPE: Jerry Trainor",
"[button] Submit Search -> CLICK",
"[button] Jerry Trainor -> CLICK",
"[li] Upcoming -> CLICK"
]
},
{
"website": "underarmour",
"id": "cdd64586-2f2e-4000-89fa-200feefcd97d",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Find newly arrived Batting Gloves for women",
"action_reprs": [
"[link] New flame Icon -> CLICK",
"[link] Womens -> CLICK",
"[div] Product Category -> CLICK",
"[link] Accessories -> CLICK",
"[link] Women's UA Radar Batting Gloves -> CLICK"
]
},
{
"website": "underarmour",
"id": "eb609e15-ff10-4b3d-82ce-348c439548ca",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Shop for UA outlet clothing and find a outdoor sports jacket in size ymd.",
"action_reprs": [
"[menuitem] Outlet -> CLICK",
"[link] Girls -> CLICK",
"[link] Jackets -> CLICK",
"[div] Product Category -> CLICK",
"[link] Clothing -> CLICK",
"[div] Product Type -> CLICK",
"[link] Jackets -> CLICK",
"[div] Sports -> CLICK",
"[link] Outdoor -> CLICK",
"[div] Size -> CLICK",
"[link] YMD -> CLICK"
]
},
{
"website": "kayak",
"id": "d88f70e8-9b66-4f08-9aa4-e49375b14920",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Browse for places to stay in Santa Fe, New Mexico for a weekend starting on Jun 16th for 3 guests and 2 rooms.",
"action_reprs": [
"[link] Search for hotels -> CLICK",
"[textbox] Enter a city, hotel, airport, address or landmark -> TYPE: Santa Fe",
"[span] Santa Fe, New Mexico, United States -> CLICK",
"[div] 16 -> CLICK",
"[div] 18 -> CLICK",
"[button] Increment -> CLICK",
"[button] Increment -> CLICK",
"[path] -> CLICK"
]
},
{
"website": "kayak",
"id": "e7fbd3a3-d583-46b9-ad7e-3f7b765fc311",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "check cheap flights from NYC to London on 23rd of April for students over 18 years.",
"action_reprs": [
"[link] Search for flights -> CLICK",
"[svg] -> CLICK",
"[tab] One-way -> CLICK",
"[button] 1 adult -> CLICK",
"[button] Increment -> CLICK",
"[path] -> CLICK",
"[textbox] Flight destination input -> CLICK",
"[textbox] Flight origin input -> TYPE: new york",
"[button] Remove -> CLICK",
"[span] New York, United States -> CLICK",
"[textbox] Flight destination input -> TYPE: london",
"[span] All airports -> CLICK",
"[generic] Thursday April 20th -> CLICK",
"[div] 23 -> CLICK",
"[path] -> CLICK",
"[span] Cheapest -> CLICK"
]
},
{
"website": "ign",
"id": "b49f88ac-b407-41af-a9e7-f5e4cd1f970a",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Check the rating and user reviews for the game \"Deathloop\".",
"action_reprs": [
"[button] Search -> CLICK",
"[searchbox] Search -> TYPE: Deathloop",
"[div] Deathloop -> CLICK"
]
},
{
"website": "kayak",
"id": "f3bf7fe9-6987-4153-81b4-4b51fe25bbbc",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Search for rental cars in Seattle, WA and filter the results by the Best score.",
"action_reprs": [
"[link] Search for cars -> CLICK",
"[textbox] Pick-up location -> CLICK",
"[textbox] Pick-up location -> TYPE: Seattle",
"[span] Seattle, Washington, United States -> CLICK",
"[svg] -> CLICK",
"[svg] -> CLICK",
"[tab] Best score -> CLICK"
]
},
{
"website": "kayak",
"id": "f7c2c65f-9415-4e1e-8ce7-a2e22ff2492c",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find the quickest one-way flight from New York To Paris on June 4 for two adults with one carry-on and one check-in bag in business class.",
"action_reprs": [
"[svg] -> CLICK",
"[tab] One-way -> CLICK",
"[svg] -> CLICK",
"[button] Increment -> CLICK",
"[path] -> CLICK",
"[textbox] Flight origin input -> TYPE: NEW YORK",
"[span] All airports -> CLICK",
"[textbox] Flight destination input -> TYPE: PARIS",
"[span] All airports -> CLICK",
"[path] -> CLICK",
"[div] 4 -> CLICK",
"[svg] -> CLICK",
"[button] Increment -> CLICK",
"[button] Increment -> CLICK",
"[svg] -> CLICK",
"[span] Quickest -> CLICK",
"[button] Cabin -> CLICK",
"[div] -> CLICK",
"[div] -> CLICK",
"[div] -> CLICK",
"[div] -> CLICK",
"[div] View Deal -> CLICK"
]
},
{
"website": "carnival",
"id": "453da07e-cb2b-4f05-80c5-5b3bc6413086",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Show me FAQs related to eating and drinks",
"action_reprs": [
"[button] Plan -> HOVER",
"[use] -> CLICK",
"[img] -> CLICK"
]
},
{
"website": "carnival",
"id": "6a326478-2a1b-4e47-b298-53f3ac12ed51",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Go to the page with information about luggage and what to bring.",
"action_reprs": [
"[button] Plan -> HOVER",
"[use] -> CLICK",
"[link] What to Pack & Bring -> CLICK"
]
},
{
"website": "carnival",
"id": "6d963cc0-90d3-4908-bee4-29a8530536af",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Show me all my offers for 2-5 day cruises",
"action_reprs": [
"[button] Plan -> HOVER",
"[use] -> CLICK",
"[select] DURATION -> SELECT: 2 - 5 Days",
"[button] Filter Results -> CLICK"
]
},
{
"website": "carnival",
"id": "7cbd1771-ca62-47ed-97db-5577644d285c",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Add to my favorites a cruise for 4 people going to Caribbean.",
"action_reprs": [
"[button] SAIL TO -> CLICK",
"[button] Caribbean -> CLICK",
"[button] SEARCH CRUISES -> CLICK",
"[button] Number of Guests -> CLICK",
"[path] -> CLICK",
"[button] Increase to 4 guest button -> CLICK",
"[button] Number of Guests -> CLICK",
"[path] -> CLICK"
]
},
{
"website": "carnival",
"id": "9365fba7-2698-4063-b151-dd0bd55e0f50",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Show me all the cruises that go from Miami Florida to The Bahamas",
"action_reprs": [
"[button] SAIL TO -> CLICK",
"[button] The Bahamas -> CLICK",
"[button] SAIL FROM -> CLICK",
"[button] Miami, FL -> CLICK",
"[button] SEARCH CRUISES -> CLICK"
]
},
{
"website": "carnival",
"id": "984f5bdb-d6d0-4b9d-ae23-bee8283a4f40",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Shop 2-5 day cruises to the Caribbean from Miami during August 2023.",
"action_reprs": [
"[link] 2-5 DAY CRUISES Get big savings! Check out 2-5 day... -> CLICK",
"[button] Sail To -> CLICK",
"[button] Caribbean -> CLICK",
"[div] Sail From -> CLICK",
"[button] Miami, FL -> CLICK",
"[svg] -> CLICK",
"[button] August -> CLICK"
]
},
{
"website": "united",
"id": "c9f2258a-07c3-46ed-a974-01543606b31b",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find deals for Honolulu from New York with budget of $1300 for premium economy.",
"action_reprs": [
"[tab] DEALS -> CLICK",
"[link] Flights to popular destinations -> CLICK",
"[textbox] Input departure airport -> TYPE: New York",
"[textbox] Input arrival airport -> TYPE: Honolulu",
"[option] Honolulu, HI, US (HNL) -> CLICK",
"[textbox] Budget. Please enter a numerical value -> TYPE: 1300",
"[div] Economy -> CLICK",
"[div] Premium economy -> CLICK"
]
},
{
"website": "apple",
"id": "2a8ae104-6f06-47cb-80a0-045188125868",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "Find the Display details of new lanched iPad pro 11-inch",
"action_reprs": [
"[link] iPad -> HOVER",
"[link] Shop iPad -> CLICK",
"[img] -> CLICK"
]
},
{
"website": "target",
"id": "08f78082-3408-4714-99ea-5a699840317d",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Find a store in Magnolia Texas.",
"action_reprs": [
"[link] Find Stores -> CLICK",
"[link] View store directory -> CLICK",
"[link] Texas -> CLICK",
"[link] Magnolia -> CLICK"
]
},
{
"website": "marriott",
"id": "013faefc-26df-4eeb-be59-5638c5f9dc72",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Look for a room at the Marriott Bonvoy resort in the Caribbean for a 10-day stay starting on May 5th.",
"action_reprs": [
"[textbox] \ue900DESTINATION WHERE CAN WE TAKE YOU?SEARCH FROM CUR... -> TYPE: Carribbean",
"[button] \ue9571 NIGHT Wed, Apr 19 - Thu, Apr 20 -> CLICK",
"[span] 5 -> CLICK",
"[span] 15 -> CLICK",
"[button] Done -> CLICK",
"[button] Find Hotels -> CLICK"
]
},
{
"website": "marriott",
"id": "06a6d90b-071d-4644-8372-b928e99ae970",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Find two rooms in a cheapest hotel in Niagra Falls for three adults and one three year old kid from May 17 to May 20, view only available hotels within 100 to 200 dollar range with taxes and fees, and choose the cheapest hotel that offers free breakfast and a pool.",
"action_reprs": [
"[textbox] \ue900DESTINATION WHERE CAN WE TAKE YOU?SEARCH FROM CUR... -> TYPE: NIAGRA FALLS",
"[option] Niagara Falls, ON, Canada -> CLICK",
"[button] \ue9571 NIGHT Sun, Apr 09 - Mon, Apr 10 -> CLICK",
"[span] 17 -> CLICK",
"[span] 20 -> CLICK",
"[button] Done -> CLICK",
"[button] 1 Room, 1 Guest\ue932 -> CLICK",
"[button] Add Rooms -> CLICK",
"[button] Add Adults -> CLICK",
"[button] Add Adults -> CLICK",
"[button] Add Children -> CLICK",
"[button] Add Age -> CLICK",
"[button] Add Less than 1 -> CLICK",
"[button] Add 1 -> CLICK",
"[button] Add 2 -> CLICK",
"[button] Find Hotels -> CLICK",
"[checkbox] Show rates with taxes and all fees -> CLICK",
"[checkbox] Show available hotels only -> CLICK",
"[link] Free breakfast (18) -> CLICK",
"[link] Pool (18) -> CLICK",
"[generic] Price -> CLICK",
"[label] 100 - 200 USD (6) -> CLICK",
"[button] APPLY -> CLICK",
"[combobox] Sort by: -> CLICK",
"[option] Price -> CLICK",
"[link] VIEW RATES -> CLICK",
"[button] Member Rate Prepay Non-refundable -> CLICK",
"[label] I have read the rate details and accept the cancel... -> CLICK",
"[button] CONTINUE -> CLICK"
]
},
{
"website": "amazon",
"id": "1c6bfd10-4dcb-4a5c-bb2d-922ff9f20087",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Look for an English language book on roman empire history in the Kindle store released in the last 90 days, it should be displayed according to its latest publication date, and add the top result to the shopping list.",
"action_reprs": [
"[button] Open Menu -> CLICK",
"[link] Kindle E-readers & Books -> CLICK",
"[link] Kindle Books -> CLICK",
"[textbox] Search Amazon -> TYPE: roman empire history",
"[button] Go -> CLICK",
"[link] Kindle eBooks -> CLICK",
"[link] English -> CLICK",
"[link] Last 90 days -> CLICK",
"[span] Featured -> CLICK",
"[option] Publication Date -> CLICK",
"[img] Records of the Medieval Sword -> CLICK",
"[button] Add to List -> CLICK",
"[button] Submit -> CLICK"
]
},
{
"website": "ebay",
"id": "aaade1d2-3a7b-4373-be01-ef98ed86288e",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Find the cheapest new trash can with automated lid that is under $60 and available for Buy It Now.",
"action_reprs": [
"[combobox] Search for anything -> TYPE: trash can automatic lid",
"[option] automatic trash can lid -> CLICK",
"[textbox] Maximum Value in $ -> TYPE: 60",
"[button] Submit price range -> CLICK",
"[input] -> CLICK",
"[input] -> CLICK",
"[button] Sort selector. Best Match selected. -> CLICK",
"[button] Listing options selector. List View selected. -> CLICK",
"[link] Gallery View -> CLICK",
"[button] Sort selector. Best Match selected. -> CLICK",
"[link] Price + Shipping: lowest first -> CLICK",
"[heading] 3L Sensor Trash Can Automatic Mini Waste Basket wi... -> CLICK"
]
},
{
"website": "cabelas",
"id": "373dec75-7278-4d12-bcc3-0e802e337c4a",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "search for Tree stands with at least 3 stars, and sort the results by price from low to high.",
"action_reprs": [
"[link] Hunting -> CLICK",
"[menuitem] Climbing Stands -> CLICK",
"[svg] -> CLICK",
"[label] .Stars::before { -> CLICK",
"[svg] -> CLICK",
"[div] Price (Low to High) -> CLICK"
]
},
{
"website": "cabelas",
"id": "3f62b47b-876b-487e-8681-63e80555938d",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Search and view the details of 32-inch medium-light fishing rod for ice fishing available in stock under 100 dollars with an average rating of 4 and above.",
"action_reprs": [
"[link] Fishing -> CLICK",
"[menuitem] View All -> CLICK",
"[label] Ice Fishing -> CLICK",
"[svg] -> CLICK",
"[label] Medium Light -> CLICK",
"[svg] -> CLICK",
"[label] 32\" -> CLICK",
"[svg] -> CLICK",
"[label] Less than $100 -> CLICK",
"[span] Sort by: -> CLICK",
"[div] Price (Low to High) -> CLICK",
"[label] In Stock -> CLICK",
"[svg] -> CLICK",
"[label] .Stars::before { -> CLICK",
"[link] Clam Katana Big Fish Ice Spinning Rod -> CLICK"
]
},
{
"website": "kbb",
"id": "a67318a4-5049-4ac5-8c6b-c14fc527483f",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Browse used BWM cars made in 2010 and compare the four cheapest listings",
"action_reprs": [
"[div] BMW -> CLICK",
"[span] -> CLICK",
"[select] 1992 -> SELECT: 2010",
"[button] Close dialog -> CLICK",
"[select] 2024 -> SELECT: 2010",
"[combobox] Sort By -> SELECT: Price: Low to High",
"[span] -> CLICK",
"[span] -> CLICK",
"[span] -> CLICK",
"[span] -> CLICK",
"[link] Compare -> CLICK"
]
},
{
"website": "kbb",
"id": "ca049641-9721-4593-95c5-a47e22365b5b",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Find the cheapest new electric car with highest ev mile range per charge, see the details of the top result.",
"action_reprs": [
"[link] Cars for Sale -> HOVER",
"[link] Cars for Sale -> CLICK",
"[checkbox] New (9,776) -> CLICK",
"[heading] Fuel Type -> CLICK",
"[checkbox] Electric (175) -> CLICK",
"[heading] Electric Mile Range -> CLICK",
"[checkbox] 300+ Miles (12) -> CLICK",
"[combobox] Sort By: -> SELECT: Price - Lowest",
"[heading] New 2023 BMW i4 eDrive40 -> CLICK"
]
},
{
"website": "kohls",
"id": "33b57a14-f469-405c-8843-f7e8ceb5b1ed",
"domain": "Shopping",
"subdomain": "Department",
"confirmed_task": "Add 10 of the cheapest green shirt to my cart",
"action_reprs": [
"[textbox] Search by keyword or web id -> TYPE: shirt",
"[textbox] Search by keyword or web id -> ENTER",
"[link] Sort by: Featured -> CLICK",
"[link] Price Low-High -> CLICK",
"[img] Women's Sonoma Goods For Life\u00ae Everyday V-Neck Tee -> CLICK",
"[textbox] Product quantity -> TYPE: 10",
"[button] Add to Cart -> CLICK"
]
},
{
"website": "kohls",
"id": "47072aee-1cb7-436c-8dc6-b2a6d109a100",
"domain": "Shopping",
"subdomain": "Department",
"confirmed_task": "Browse black strollers within $100 to $250.",
"action_reprs": [
"[textbox] Search by keyword or web id -> TYPE: black stroller",
"[input] -> CLICK",
"[div] Price -> CLICK",
"[link] $100 to $250 (26) -> CLICK"
]
},
{
"website": "flightaware",
"id": "dc2aa3f8-eda0-455b-98dc-adc56089259a",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Get route information for flights from Ohio and New York airports that have already arrived.",
"action_reprs": [
"[textbox] Origin -> TYPE: Ohio",
"[div] Ohio -> CLICK",
"[textbox] Destination -> TYPE: New York",
"[div] New York -> CLICK",
"[img] Submit Search -> CLICK",
"[group] \uf067 Status -> CLICK",
"[checkbox] Diverted -> CLICK"
]
},
{
"website": "flightaware",
"id": "e8603513-2740-485e-adf9-86361dd015f4",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Compare FlightAware subscriptions and signup for Enterprise plan.",
"action_reprs": [
"[span] Products -> CLICK",
"[span] Premium Subscriptions -> CLICK",
"[button] Compare Subscriptions -> CLICK",
"[a] Upgrade -> CLICK"
]
},
{
"website": "flightaware",
"id": "ecb649da-0ca7-4707-8ebb-8707296e28b7",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Search for flights available from Calgary (CYYC) to New York (ZNY).",
"action_reprs": [
"[textbox] Origin -> TYPE: Calgary",
"[div] Calgary -> CLICK",
"[textbox] Destination -> TYPE: New York",
"[strong] New York -> CLICK",
"[img] Submit Search -> CLICK"
]
},
{
"website": "flightaware",
"id": "ef09c913-747d-4256-bd51-2b91540c5222",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find map for the KCCR airport",
"action_reprs": [
"[input] -> CLICK",
"[input] -> TYPE: KCCR",
"[option] \uf041\u00a0Buchanan Fld (Concord)\u00a0 KCCR CCR \u00a0 -> CLICK",
"[link] MAP & DIAGRAM -> CLICK"
]
},
{
"website": "foxsports",
"id": "00cef5a2-4d07-4dd9-837d-5b85ac3a63d8",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Find the Chicago Bulls team schedule for the month of April.",
"action_reprs": [
"[button] Search -> CLICK",
"[searchbox] Leagues, teams, players, shows, personalities... -> CLICK",
"[searchbox] Leagues, teams, players, shows, personalities... -> TYPE: Chicago Bulls",
"[div] Chicago Bulls -> CLICK",
"[heading] SCHEDULE -> CLICK",
"[button] April -> CLICK"
]
},
{
"website": "exploretock",
"id": "f4dcbd09-45f3-47b5-a49d-36658d5b50ca",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Find tickets for Pizza making class in New York next month.",
"action_reprs": [
"[svg] -> CLICK",
"[svg] -> CLICK",
"[searchbox] Find a location -> TYPE: NEW YORK",
"[span] New York -> CLICK",
"[combobox] Reservation type -> SELECT: Events",
"[combobox] Event date -> SELECT: Next month",
"[path] -> CLICK",
"[button] Edit cuisine type filter -> CLICK",
"[checkbox] Pizza -> CLICK",
"[button] Submit -> CLICK",
"[button] View Thursday Pizza Making Class at PDA Slice Shop... -> CLICK"
]
},
{
"website": "yelp",
"id": "b307117b-e10c-470f-a85d-968b2e442b19",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Find a coffee shop with wi-fi.",
"action_reprs": [
"[textbox] Find -> TYPE: coffee shop",
"[span] Coffee Shop -> CLICK",
"[link] Cafe de Nook -> CLICK"
]
},
{
"website": "yelp",
"id": "c2e4800e-684f-4bb6-99ab-782806c8776d",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Search for McDonalds located in Greenvill, SC.",
"action_reprs": [
"[textbox] Near -> CLICK",
"[textbox] Near -> TYPE: Greenville",
"[span] Greenville -> CLICK",
"[textbox] Find -> CLICK",
"[textbox] Find -> TYPE: McDonalds",
"[button] Search -> CLICK"
]
},
{
"website": "yelp",
"id": "c64dcaa1-555d-43f3-adb4-3452c4e5d09b",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Browse barbershops that have private lot parking.",
"action_reprs": [
"[textbox] Find -> TYPE: barbershop",
"[span] Barbershop -> CLICK",
"[button] All -> CLICK",
"[button] See all -> CLICK",
"[span] -> CLICK",
"[checkbox] Private Lot -> CLICK",
"[button] Add -> CLICK"
]
},
{
"website": "store.steampowered",
"id": "96e95a76-4a1d-491c-82ff-fac663d89ddb",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Browse a list of adventure games under 30 dollars.",
"action_reprs": [
"[link] Categories -> CLICK",
"[link] Adventure -> CLICK",
"[div] Narrow By -> CLICK",
"[div] Price -> CLICK",
"[div] -> CLICK"
]
},
{
"website": "store.steampowered",
"id": "a88676d0-c252-408f-b796-93c95f6b71fc",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Open my trade offers.",
"action_reprs": [
"[link] BUCKEYE.FOOBAR -> HOVER",
"[link] INVENTORY -> CLICK",
"[link] Trade Offers -> CLICK"
]
},
{
"website": "qatarairways",
"id": "f385156c-4f2e-410f-bc73-7ec6d0f44448",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Compare all membership tier benefits.",
"action_reprs": [
"[rect] -> CLICK",
"[textbox] e.g.: New York -> TYPE: Membership tier",
"[button] Search -> CLICK",
"[link] Privilege Club Membership Tiers -> CLICK"
]
},
{
"website": "amtrak",
"id": "f0f8088f-46dc-453a-b695-772b30421ece",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find trip for 123456 last name Smith.",
"action_reprs": [
"[button] MY TRIP -> CLICK",
"[textbox] Reservation/Ticket Number -> TYPE: 123456",
"[div] -> CLICK",
"[option] Last Name -> CLICK",
"[textbox] Last Name -> TYPE: Smith",
"[button] Find Trip -> CLICK"
]
},
{
"website": "amtrak",
"id": "f355cfcf-a3f7-47e4-b0be-b1c595e0954e",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Show me current deals for California.",
"action_reprs": [
"[button] DEALS -> CLICK",
"[link] DEALS & PROMOTIONS Amtrak travel deals, promotions... -> CLICK",
"[label] All Regions -> CLICK",
"[generic] California -> CLICK"
]
},
{
"website": "tvguide",
"id": "f9e88baa-a109-454b-839f-1ab0746a5f13",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Find all watch options of Avatar: The Way of Water and where it's available.",
"action_reprs": [
"[textbox] Search TV Shows and Movies... -> TYPE: Avatar The Way of Water",
"[div] Avatar: The Way of Water -> CLICK",
"[div] See All Where to Watch -> CLICK"
]
},
{
"website": "rottentomatoes",
"id": "86afd67c-1bff-455c-baa7-e18dcb64b0f3",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Find comedy tv shows on netflix sorted by audience score.",
"action_reprs": [
"[link] TV SHOWS -> CLICK",
"[img] netflix -> CLICK",
"[span] Genre -> CLICK",
"[div] -> CLICK",
"[button] APPLY -> CLICK",
"[span] Sort: Most popular -> CLICK",
"[span] Audience score (highest) -> CLICK"
]
},
{
"website": "rottentomatoes",
"id": "b2c18588-b115-4937-b69f-8feeab22c387",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Locate the list of movies \"at home\", sorted by most recent.",
"action_reprs": [
"[link] MOVIES -> CLICK",
"[button] IN THEATERS -> CLICK",
"[link] AT HOME -> CLICK",
"[span] Genre -> CLICK",
"[div] -> CLICK",
"[button] APPLY -> CLICK",
"[span] Sort -> CLICK",
"[span] Newest -> CLICK"
]
},
{
"website": "nps.gov",
"id": "0db002f6-db7d-4382-9c0d-8f5cef2afa17",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find detailed uses of Anuall Pass for 2023 on the USGS Online",
"action_reprs": [
"[button] Open Menu -> CLICK",
"[link] Passes -> CLICK",
"[link] Annual Pass -> CLICK",
"[button] Overview of the Annual Pass -> CLICK",
"[button] Annual Pass Internet Order Questions -> CLICK",
"[button] Annual Pass Use -> CLICK",
"[button] Annual Pass - Further Information -> CLICK"
]
},
{
"website": "bookdepository",
"id": "cf8b2846-ac33-46aa-887c-174de6184057",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Show status of my order with order number X123456789 and email buckeye.foobar@gmail.com",
"action_reprs": [
"[link] \ud83d\ude9aOrder Status -> CLICK",
"[textbox] Order number * -> TYPE: X123456789",
"[textbox] E-mail used on order * -> TYPE: buckeye.foobar@gmail.com",
"[button] View -> HOVER"
]
},
{
"website": "bookdepository",
"id": "db72bae1-ff16-495c-89c7-1cff7c0ae503",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "check the most popular Spanish recipe book available in paperback that are in stock.",
"action_reprs": [
"[textbox] Search for books by keyword / title / author / ISB... -> TYPE: recipe",
"[link] recipe book -> CLICK",
"[select] All -> SELECT: In Stock (7,640)",
"[select] All -> SELECT: Spanish (42)",
"[select] All -> SELECT: Paperback (39,356)",
"[button] Refine results -> CLICK"
]
},
{
"website": "carmax",
"id": "706d0ccd-c0ec-423d-88c0-a5716700a855",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Search for used BMW X5 Crossovers and compare the mileage of the first two cars.",
"action_reprs": [
"[link] Shop -> CLICK",
"[link] Crossover vehicle icon Crossovers -> CLICK",
"[button] Make -> CLICK",
"[listitem] BMW (389) BMW (389) -> CLICK",
"[button] Back to all categories -> CLICK",
"[button] Model -> CLICK",
"[listitem] X5 (87) X5 (87) -> CLICK",
"[path] -> CLICK",
"[switch] COMPARE -> CLICK",
"[button] Add to Compare -> CLICK",
"[button] Add to Compare -> CLICK",
"[button] Go button to Compare the Selected Car's -> CLICK",
"[div] Mileage -> HOVER"
]
},
{
"website": "carmax",
"id": "76294719-e146-4f92-986f-42b86a9808c7",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Find a store in Los Angeles, California, and set Riverside as my store and add a card from that store to my favorites",
"action_reprs": [
"[link] Find a store -> CLICK",
"[p] 31 stores -> CLICK",
"[span] see all stores -> CLICK",
"[button] SET AS MY STORE -> CLICK",
"[link] SHOP LOCAL CARS -> CLICK",
"[img] Car not saved -> CLICK"
]
},
{
"website": "carmax",
"id": "8710addc-5ff3-4aaf-b397-4c6165f285ee",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Show me the service options for cars under warranty.",
"action_reprs": [
"[button] Open helpful links menu -> CLICK",
"[link] Service & Repairs -> CLICK",
"[tab] Yes -> CLICK"
]
},
{
"website": "carmax",
"id": "8ab1c90f-52e0-4c07-9d41-d44c75c25c5e",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Search for an automatic grey sports car with the lowest price, gas fuel and free shipping manufactured between 2018 to 2022, compare the top two results and compare photos.",
"action_reprs": [
"[link] Shop -> CLICK",
"[img] Sports car icon -> CLICK",
"[button] Sort by -> CLICK",
"[label] Lowest price -> CLICK",
"[button] Back to all categories -> CLICK",
"[button] Fuel Type -> CLICK",
"[listitem] Gas (45) Gas (45) -> CLICK",
"[button] Back to all categories -> CLICK",
"[button] Year -> CLICK",
"[button] 2010 -> CLICK",
"[menuitem] 2018 -> CLICK",
"[button] 2023 -> CLICK",
"[menuitem] 2022 -> CLICK",
"[button] Back to all categories -> CLICK",
"[button] Exterior Color -> CLICK",
"[listitem] Gray (5) Gray (5) -> CLICK",
"[button] Back to all categories -> CLICK",
"[button] Transmission -> CLICK",
"[span] Automatic -> CLICK",
"[button] Back to all categories -> CLICK",
"[heading] Distance & Shipping -> CLICK",
"[button] $99 Or Less -> CLICK",
"[menuitem] Free to home or store -> CLICK",
"[button] Back to all categories -> CLICK",
"[switch] COMPARE -> CLICK",
"[path] -> CLICK",
"[button] Add to Compare -> CLICK",
"[button] Go button to Compare the Selected Car's -> CLICK",
"[button] COMPARE PHOTOS -> CLICK"
]
},
{
"website": "jetblue",
"id": "81b6bba7-3d05-40a4-a475-48eaeacbda0d",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Show route map and flight cost from Los Angeles to Miami on 12 April.",
"action_reprs": [
"[div] -> CLICK",
"[link] Route Map -> CLICK",
"[textbox] From -> CLICK",
"[textbox] From -> TYPE: Los Angeles",
"[div] Los Angeles -> CLICK",
"[textbox] To -> TYPE: Miami",
"[option] Mint. Miami area -> CLICK",
"[button] Explore flights -> CLICK",
"[span] 234 -> CLICK",
"[button] Total: $234.00 1 traveler See Flights -> CLICK"
]
},
{
"website": "jetblue",
"id": "85706225-aa42-43c1-8cfa-8696118698a2",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Check the status of flights from Los Angeles area to Boston area tomorrow",
"action_reprs": [
"[button] Travel Info -> CLICK",
"[link] Flight Tracker -> CLICK",
"[textbox] From -> TYPE: Los Angeles",
"[option] Los Angeles area -> CLICK",
"[textbox] To -> TYPE: Boston",
"[option] Boston area -> CLICK",
"[button] Today, Tue Apr 11 -> CLICK",
"[span] Tomorrow, Wed Apr 12 -> CLICK",
"[span] Check status -> CLICK"
]
},
{
"website": "spothero",
"id": "0b59dd33-7f6a-48df-aa1e-9cc67177287f",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find a parking spot near Dallas Love Field Airport.",
"action_reprs": [
"[tab] Airport -> CLICK",
"[searchbox] Airport Name, Code or City -> TYPE: Dallas Love Field",
"[li] Dallas Love Field (DAL) -> CLICK"
]
},
{
"website": "spothero",
"id": "0fc98662-4405-4a30-9854-9301c98fdb37",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "What are the parking options in Florida to book to enter on may 6 at 5 pm and leave the same day at 6pm?",
"action_reprs": [
"[textbox] Search for parking -> TYPE: florida",
"[li] Florida, USA -> CLICK",
"[textbox] Start Date -> CLICK",
"[svg] -> CLICK",
"[gridcell] Sat May 06 2023 -> CLICK",
"[combobox] Start Time -> SELECT: 5:00 PM",
"[combobox] End Time -> SELECT: 6:00 PM",
"[button] Update Search -> CLICK"
]
},
{
"website": "spothero",
"id": "1d173ebb-ff7a-4e6b-9911-0f0349f9a174",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find parking in New York City by month on July 5th start date.",
"action_reprs": [
"[tab] Monthly -> CLICK",
"[textbox] Search for parking -> TYPE: New York",
"[li] New York, NY, USA -> CLICK",
"[textbox] Monthly Start Date -> CLICK",
"[svg] -> CLICK",
"[svg] -> CLICK",
"[path] -> CLICK",
"[svg] -> CLICK",
"[gridcell] Wed Jul 05 2023 -> CLICK",
"[button] Update Search -> CLICK"
]
},
{
"website": "spothero",
"id": "3f0988e0-e3a4-4dd7-a89f-482175a474a8",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find Wheelchair accessible parking for April 09 event in Barclays Center that allows entry after 10am",
"action_reprs": [
"[textbox] Search for parking -> TYPE: Barclays Center",
"[li] Barclays Center, Atlantic Avenue, Brooklyn, NY, US... -> CLICK",
"[textbox] Select Event Date -> CLICK",
"[gridcell] Sun Apr 09 2023 -> CLICK",
"[p] Philadelphia 76ers at Brooklyn Nets -> CLICK",
"[button] Filter -> CLICK",
"[checkbox] Wheelchair Accessible (18) -> CLICK",
"[button] Show 18 Results -> CLICK",
"[combobox] Start Time -> SELECT: 10:00 AM",
"[button] Update Search -> CLICK"
]
},
{
"website": "underarmour",
"id": "ccb7c231-8655-4613-a28f-beb8074c523e",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "find the Under Armour Return Policy for Men's UA Football All Over Print Metal Logo Short Sleeve",
"action_reprs": [
"[menuitem] Men -> CLICK",
"[link] Shirts & Tops -> CLICK",
"[link] Graphic T-shirts -> CLICK",
"[div] Sports -> CLICK",
"[link] Football -> CLICK",
"[link] Men's UA Football All Over Print Metal Logo Short ... -> CLICK",
"[button] Free Returns & Exchanges \ue90b -> CLICK"
]
},
{
"website": "united",
"id": "c497534c-76a5-4ffb-af9a-10ee7afcc784",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find a car to book with miles to pick up on Caldwell (Ohio) on april 8 at 8 am and return on april 13 on noon at the same location",
"action_reprs": [
"[heading] CAR -> CLICK",
"[label] Book with miles -> CLICK",
"[LabelText] Enter pick up city, airport name, or airport code. -> TYPE: caldwell",
"[div] Caldwell -> CLICK",
"[textbox] Pickup -> CLICK",
"[button] Saturday, April 8, 2023 -> CLICK",
"[button] Thursday, April 13, 2023 -> CLICK",
"[combobox] Pickup time Selected 10:00 a.m. -> CLICK",
"[combobox] Pickup time Selected 10:00 a.m. -> CLICK",
"[option] 8:00 a.m. -> CLICK",
"[combobox] Drop off time Selected 10:00 a.m. -> CLICK",
"[option] 12:00 p.m. -> CLICK",
"[button] Find cars button. -> CLICK"
]
},
{
"website": "seatgeek",
"id": "10de6ac5-a69e-4d09-87fd-5737ca6f4b99",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "check ticket listing on floor B row 17 seat listing to Beyonc\u00e9 music concert on Mon Aug 14 at 7:00pm.",
"action_reprs": [
"[link] Music -> HOVER",
"[a] Trending -> HOVER",
"[link] Beyonce -> CLICK",
"[button] Filter by\u00a0Date -> CLICK",
"[button] Next month -> CLICK",
"[button] Next month -> CLICK",
"[button] Next month -> CLICK",
"[div] 14 -> CLICK",
"[button] Apply -> CLICK",
"[span] From $73 -> CLICK",
"[img] Overhead map of Floor B -> CLICK"
]
},
{
"website": "mbta",
"id": "e2adf8f1-547d-4671-96c1-4a21a56e135d",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "View the upcoming schedule from Otis St@Summer St to City Point of the transit near South Station for today.",
"action_reprs": [
"[tab] Schedules -> CLICK",
"[span] Transit Near Me -> CLICK",
"[input] -> TYPE: South Station",
"[option] South Station, 700 Atlantic Ave, Boston, MA 02110,... -> CLICK",
"[link] Go to route -> CLICK",
"[button] City Point -> CLICK",
"[menuitem] City Point typical route -> CLICK",
"[button] View schedule -> CLICK"
]
},
{
"website": "mbta",
"id": "edbac1c3-5409-48b0-a0ac-402a4900c59f",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Show me the planned service alerts for the subway red line",
"action_reprs": [
"[link] subway Subway Lines -> CLICK",
"[span] Red Line -> CLICK",
"[link] Alerts 8 alerts -> CLICK",
"[link] Planned Service Alerts -> CLICK"
]
},
{
"website": "mbta",
"id": "fa2828c5-44b3-446e-ae42-a26438ed8343",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Show me the upcoming departures for the oak grove station going southbound direction",
"action_reprs": [
"[combobox] Search MBTA.com -> TYPE: oak grove station",
"[button] search -> CLICK",
"[link] T orange line bus commuter rail Zone 1A Oak Grove -> CLICK",
"[link] Go to route -> CLICK",
"[button] View upcoming departures -> CLICK",
"[combobox] Choose a direction -> SELECT: SOUTHBOUND Forest Hills",
"[button] Oak Grove Zone 1A -> CLICK"
]
},
{
"website": "mbta",
"id": "fd0e4520-b47b-4a24-9b21-d10e68c42472",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Plan a trip from Braintree to Boston Airport on April 14, 12 pm, and see the fair calculator.",
"action_reprs": [
"[tab] Trip Planner -> CLICK",
"[combobox] From -> TYPE: brain",
"[link] T red line bus commuter rail Zone 2 Braintree -> CLICK",
"[combobox] To\u00a0 -> TYPE: boston",
"[span] Boston -> CLICK",
"[button] Get trip suggestions -> CLICK",
"[button] Depart at 8:40 AM, 4/10/23 \uf107 -> CLICK",
"[LabelText] Monday, April 10, 2023, click or press the enter o... -> CLICK",
"[gridcell] Friday, April 14, 2023 -> CLICK",
"[combobox] Hour -> TYPE: 12",
"[combobox] Minute -> TYPE: 00",
"[combobox] AM or PM -> SELECT: PM",
"[button] Get trip suggestions -> CLICK",
"[button] Show fare calculator \uf107 -> CLICK"
]
},
{
"website": "instacart",
"id": "51fce1f7-566e-4ae4-89a4-dea4d0ec569e",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Find an available wine at Kroger.",
"action_reprs": [
"[path] -> CLICK",
"[button] Departments -> CLICK",
"[link] Wine -> CLICK",
"[p] Kroger -> CLICK"
]
},
{
"website": "newegg",
"id": "549a9805-e404-4dcf-8c72-ddf46471114b",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "Compare two wireless printers that are rated above 4 stars.",
"action_reprs": [
"[searchbox] Search Site -> TYPE: wireless printer",
"[button] \uf002 -> CLICK",
"[dt] Customer Ratings -> CLICK",
"[i] -> CLICK",
"[button] APPLY -> CLICK",
"[span] Compare -> CLICK",
"[span] Compare -> CLICK",
"[button] COMPARE -> CLICK"
]
},
{
"website": "boardgamegeek",
"id": "9f4b6bd4-69dc-4103-b1c4-eb621639e9dd",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "List of publishers for board games",
"action_reprs": [
"[button] Browse -> CLICK",
"[link] Publishers -> CLICK"
]
},
{
"website": "boardgamegeek",
"id": "b040b35d-cfd3-41b8-8b8b-851ab151a9cc",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "View the complexity rating for Frosthaven.",
"action_reprs": [
"[combobox] Search -> TYPE: frosthaven",
"[link] Frosthaven (2023) -> CLICK",
"[div] 'Complexity' Rating -> CLICK"
]
},
{
"website": "boardgamegeek",
"id": "c4ca9c7a-d31a-4b3b-b6b4-c442854e9da1",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "What are Gloomhaven's ratings?",
"action_reprs": [
"[combobox] Search -> TYPE: gloomhaven",
"[link] Gloomhaven (2017) -> CLICK",
"[tab] Ratings -> CLICK"
]
},
{
"website": "boardgamegeek",
"id": "c95b0276-a588-4aeb-906f-a3f6f1c205ae",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Show me the list of BGG shirts for sale",
"action_reprs": [
"[button] Shopping -> CLICK",
"[link] BGG Store -> CLICK",
"[link] Clothing -> CLICK",
"[link] Shirts and Hoodies -> CLICK"
]
},
{
"website": "yelp",
"id": "c987dd1d-9ade-4701-8cdb-a31f8f3bf673",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Look for a best rated Thai restaurant in Westminster, California, that provides takeout, and whose staff is fully vaccinated and accepts Apple pay.",
"action_reprs": [
"[link] Restaurants -> HOVER",
"[span] Thai -> CLICK",
"[textbox] Near -> TYPE: WESTMINSTER",
"[span] Westminster -> CLICK",
"[checkbox] Offers Takeout -> CLICK",
"[button] Thai -> CLICK",
"[button] See all -> CLICK",
"[checkbox] All staff fully vaccinated -> CLICK",
"[checkbox] Accepts Apple Pay -> CLICK",
"[button] Search -> CLICK",
"[button] Recommended -> CLICK",
"[span] Highest Rated -> CLICK"
]
},
{
"website": "yelp",
"id": "d9e9c178-e945-49fe-9d06-a01cf02ab2db",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Browse the highest rated spas that are $$ dollar signs and under.",
"action_reprs": [
"[textbox] Find -> TYPE: spa",
"[span] Spa -> CLICK",
"[button] Price: -> CLICK",
"[input] -> CLICK",
"[input] -> CLICK",
"[span] Save -> CLICK",
"[button] Recommended -> CLICK",
"[span] Highest Rated -> CLICK"
]
},
{
"website": "target",
"id": "44bde32f-12bd-4c70-a1a5-37bdadfe872b",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Find target branded sprinkles for easter baking",
"action_reprs": [
"[link] Categories -> CLICK",
"[span] Grocery -> CLICK",
"[span] Easter Baking -> CLICK",
"[img] -> CLICK",
"[button] Brand -> CLICK",
"[div] -> CLICK",
"[button] close -> CLICK"
]
},
{
"website": "target",
"id": "632bb279-036c-48e5-b40a-962b2e90d6d1",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Browse winter coats featured in the weekly ad and is at least 15% off.",
"action_reprs": [
"[searchbox] Search: suggestions appear below -> TYPE: winter coat",
"[button] go -> CLICK",
"[button] Deals -> CLICK",
"[div] -> CLICK",
"[button] Update -> CLICK",
"[button] Discount -> CLICK",
"[div] -> CLICK",
"[button] Update -> CLICK"
]
},
{
"website": "target",
"id": "6803cd71-78a9-4bff-a1a3-1153dcc28c11",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Find organic dog food and add it to the cart.",
"action_reprs": [
"[searchbox] Search: suggestions appear below -> TYPE: organic dog food",
"[link] organic dog food -> CLICK",
"[link] Tender & True Organic Small Breed Chicken and Live... -> CLICK",
"[button] Add to cart for Tender & True Organic Small Breed ... -> CLICK"
]
},
{
"website": "flightaware",
"id": "ccd8d9f9-65f1-42ac-a699-5db7e380c760",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find flights from Washington airports to New York airports and only show those with scheduled status.",
"action_reprs": [
"[link] Flight Tracking -> HOVER",
"[link] Flight Finder -> CLICK",
"[textbox] Origin -> TYPE: Washington",
"[div] Washington -> CLICK",
"[textbox] Destination -> TYPE: New York",
"[div] New York -> CLICK",
"[img] Submit Search -> CLICK",
"[group] \uf067 Status -> CLICK",
"[link] only -> CLICK"
]
},
{
"website": "flightaware",
"id": "d538537c-ff96-4918-8807-af09b26199d1",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find a flights between SFO and EWR using the Boeing 787-9 aircraft",
"action_reprs": [
"[textbox] Origin -> CLICK",
"[textbox] Origin -> TYPE: SFO",
"[div] San Francisco Int'l (San Francisco) - -> CLICK",
"[textbox] Destination -> CLICK",
"[textbox] Destination -> TYPE: EWR",
"[div] Newark Liberty Intl (Newark) - -> CLICK",
"[img] Submit Search -> CLICK",
"[span] -> CLICK",
"[link] only -> CLICK"
]
},
{
"website": "uniqlo",
"id": "ddcbce13-4c42-4c40-99ab-2c58588f1ccf",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Find Mens orange color Jacket and parkas with L Size and add to cart",
"action_reprs": [
"[link] MEN -> HOVER",
"[link] Jackets & Parkas -> CLICK",
"[heading] Pocketable UV Protection 3D Cut Parka -> CLICK",
"[checkbox] ORANGE -> HOVER",
"[checkbox] L -> HOVER",
"[button] ADD TO CART -> CLICK"
]
},
{
"website": "uniqlo",
"id": "ddd935d4-9c28-4e64-bb4f-91ad1cb974dc",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "See in the Men's sale if any L-sized t-shirt in blue color is available or not, if available, add one to the cart choose pick in store for zip 10005.",
"action_reprs": [
"[link] MEN -> HOVER",
"[link] Sale -> CLICK",
"[heading] Category -> CLICK",
"[input] -> CLICK",
"[option] Tops -> CLICK",
"[heading] Size -> CLICK",
"[label] L -> CLICK",
"[heading] Color -> CLICK",
"[label] BLACK -> CLICK",
"[svg] -> CLICK",
"[heading] Supima\u00ae Cotton V-Neck Short-Sleeve T-Shirt (2022 E... -> CLICK",
"[checkbox] L -> CLICK",
"[button] ADD TO CART -> CLICK",
"[button] VIEW CART -> CLICK",
"[button] CHECKOUT -> CLICK",
"[button] Pick up in store Shipping: Free -> CLICK",
"[searchbox] City, State, or ZIP code -> TYPE: 10005",
"[svg] -> CLICK",
"[label] UNIQLO SOHO -> CLICK",
"[button] PICK UP IN THIS STORE -> CLICK"
]
},
{
"website": "rentalcars",
"id": "06497906-8b76-4367-a1b3-ebc8238bd470",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Choose a lowest priced hybrid SUV car to pick up from Bangkok downtown on May 24 at 9:30 am and drop off on May 28, at 9 am.",
"action_reprs": [
"[label] Pick-up location -> TYPE: BANGKOK",
"[div] Downtown Bangkok -> CLICK",
"[div] Thu, Apr 20 -> CLICK",
"[checkbox] 24 May 2023 -> CLICK",
"[checkbox] 28 May 2023 -> CLICK",
"[combobox] Pick up time -> SELECT: 9:30 AM",
"[combobox] Drop off time -> SELECT: 9:00 AM",
"[div] Search -> CLICK",
"[div] SUVs -> CLICK",
"[span] -> CLICK",
"[label] Price (lowest first) -> CLICK",
"[div] View deal -> CLICK"
]
},
{
"website": "rentalcars",
"id": "36f2e415-356b-4e44-9ab1-6c3054d4de1f",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Check if cars are available for tomorrow at Elevated Escape in North Carolina.",
"action_reprs": [
"[textbox] Pick-up location -> TYPE: Elevated Escape",
"[div] Elevated Escape -> CLICK",
"[div] Tue, Mar 28 -> CLICK",
"[checkbox] 24 March 2023 -> CLICK",
"[div] Sat, Mar 25 -> CLICK",
"[checkbox] 25 March 2023 -> CLICK",
"[button] Search -> CLICK"
]
},
{
"website": "rentalcars",
"id": "8082086a-10a7-4631-9792-b57337426f9a",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Find a SUV with automatic transmission in New York drop off at March 30.",
"action_reprs": [
"[textbox] Pick-up location -> TYPE: New York",
"[div] New York, NY -> CLICK",
"[div] Sat, Apr 1 -> CLICK",
"[checkbox] 30 March 2023 -> CLICK",
"[div] Search -> CLICK",
"[img] -> CLICK",
"[span] -> CLICK"
]
},
{
"website": "rentalcars",
"id": "81835704-aebc-4600-abd4-02102509fda5",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Find a premium 4-door car with automatic transmission and unlimited mileage at Heathrow Airport for pickup, on date April 26, 2 pm, and drop off at the same Airport on April 30, 1 pm, book a range rover if available with full protection.",
"action_reprs": [
"[label] Pick-up location -> TYPE: Heathrow",
"[div] London Heathrow Airport (LHR) -> CLICK",
"[div] Wed, Apr 19 -> CLICK",
"[checkbox] 26 April 2023 -> CLICK",
"[combobox] Pick up time -> SELECT: 2:00 PM",
"[span] -> CLICK",
"[div] Thu, Apr 27 -> CLICK",
"[checkbox] 30 April 2023 -> CLICK",
"[combobox] Drop off time -> SELECT: 1:00 PM",
"[div] Search -> CLICK",
"[div] Premium -> CLICK",
"[svg] -> CLICK",
"[span] -> CLICK",
"[path] -> CLICK",
"[span] -> CLICK",
"[heading] Car specs -> CLICK",
"[span] -> CLICK",
"[div] View deal -> CLICK",
"[span] Go to book -> CLICK"
]
},
{
"website": "kbb",
"id": "d3a4e6c3-65e8-46f7-8dd7-439bc559af2a",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Find value of 2016 Toyota Camry XLE Sedan 4D in black color with number plate AZXA46.",
"action_reprs": [
"[link] Car Values -> HOVER",
"[link] My Car's Value -> CLICK",
"[div] Make/Model -> CLICK",
"[combobox] Year -> SELECT: 2016",
"[combobox] Make -> SELECT: Toyota",
"[combobox] Model -> SELECT: Camry",
"[textbox] Mileage -> TYPE: 40000",
"[button] Go -> CLICK",
"[div] XLE Sedan 4D -> CLICK",
"[button] Next -> CLICK",
"[div] Select Your Options -> CLICK",
"[generic] Black image Black -> CLICK",
"[button] Next -> CLICK",
"[span] -> CLICK",
"[button] Next -> CLICK",
"[div] License Plate -> CLICK",
"[textbox] License Plate -> TYPE: AZXA46",
"[combobox] State -> SELECT: AZ",
"[button] Go -> HOVER"
]
},
{
"website": "kbb",
"id": "e2f8b054-59b5-4fd8-bd58-9f95b29f979d",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Find cheapest 2018 Honda Civic for sale within 100 miles of 07055",
"action_reprs": [
"[link] Cars for Sale -> CLICK",
"[textbox] ZIP Code -> TYPE: 07055",
"[combobox] Distance -> SELECT: 100 Miles",
"[combobox] Minimum Year -> SELECT: 2018",
"[combobox] Maximum Year -> SELECT: 2018",
"[button] Make \ue920 -> CLICK",
"[checkbox] Honda (549) -> CLICK",
"[checkbox] Civic (122) -> CLICK",
"[combobox] Sort By: -> SELECT: Price - Lowest"
]
},
{
"website": "gamestop",
"id": "2705de3e-4461-4668-8573-8f10c1eb6641",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find a low-priced refurbished Microsoft Xbox one console in white color and available in stock.",
"action_reprs": [
"[button] Main Menu -> CLICK",
"[button] Consoles & Hardware chevron_right -> CLICK",
"[button] Xbox One -> CLICK",
"[link] Filter -> CLICK",
"[generic] Refine by Category: Consoles -> CLICK",
"[checkbox] Microsoft Microsoft -> CLICK",
"[button] Color -> CLICK",
"[link] White -> CLICK",
"[div] Condition -> CLICK",
"[checkbox] Refurbished Refurbished -> CLICK",
"[div] Availability -> CLICK",
"[checkbox] In Stock In Stock -> CLICK",
"[button] Done -> CLICK",
"[button] Best Matches -> CLICK",
"[link] Price Low To High -> CLICK",
"[p] Xbox One White 500GB -> CLICK"
]
},
{
"website": "bookdepository",
"id": "01dcf2f1-0b80-4819-a4d1-5063062d1aa5",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Search for Romantic Audio fiction books with the lowest price.",
"action_reprs": [
"[link] Shop by category\u2228 -> HOVER",
"[link] Audio Books -> CLICK",
"[link] Fiction -> CLICK",
"[link] Romance -> CLICK",
"[select] Most popular -> SELECT: Price, low to high"
]
},
{
"website": "bookdepository",
"id": "0a2130e7-1108-4281-8772-25c8671fb88e",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Search for a non-fiction children's book for ages 9-11 on the topic of history in the Hindi language, and add the top book to the cart, if not available choose notify me option and also add the book to new wishlist must buy.",
"action_reprs": [
"[link] Shop by category\u2228 -> HOVER",
"[link] Children's Books -> CLICK",
"[link] Non-Fiction -> CLICK",
"[link] History -> CLICK",
"[select] All -> SELECT: Ages 9-11 (13,217)",
"[select] All -> SELECT: Hindi (59)",
"[button] Refine results -> CLICK",
"[link] Notify me -> CLICK",
"[link] Add to wishlist -> CLICK",
"[textbox] Wishlist name -> TYPE: Must buy",
"[button] Add -> CLICK"
]
},
{
"website": "uniqlo",
"id": "cbfa5c92-41cb-4481-97b2-9fb41298be13",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Find a wireless bra in size xxs or s, add one brown and one purple color to the cart and view the total cart value.",
"action_reprs": [
"[link] WOMEN -> HOVER",
"[tab] Innerwear & Underwear -> CLICK",
"[link] Bras -> CLICK",
"[heading] Category -> CLICK",
"[input] -> CLICK",
"[option] Relaxed Wireless -> CLICK",
"[heading] Size -> CLICK",
"[label] XXS -> CLICK",
"[svg] -> CLICK",
"[heading] Wireless Bra (Ultra Relax) -> CLICK",
"[checkbox] BROWN -> CLICK",
"[button] ADD TO CART -> CLICK",
"[button] CONTINUE SHOPPING -> CLICK",
"[checkbox] PURPLE -> CLICK",
"[button] ADD TO CART -> CLICK",
"[button] VIEW CART -> CLICK"
]
},
{
"website": "yellowpages",
"id": "01bede1e-91ec-4fe0-a6bc-173826497800",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Find a person by phone number 123456789.",
"action_reprs": [
"[link] Find People -> CLICK",
"[link] BY PHONE\u00a0NUMBER -> CLICK",
"[input] -> TYPE: 123456789",
"[button] Search by Phone -> CLICK"
]
},
{
"website": "yellowpages",
"id": "229199b4-9988-485f-8175-b5efd8faf08b",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Ask a question regarding Health Insurance Top Up plans beneficial or not?",
"action_reprs": [
"[link] QUESTIONS & ANSWERS -> CLICK",
"[link] Insurance -> CLICK",
"[textbox] Ask a Question -> TYPE: Health Insurance Top Up plans beneficial or not?",
"[button] Add a Question -> HOVER"
]
},
{
"website": "yellowpages",
"id": "3b390b60-5c04-40ee-a5af-353def43ffbc",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Show me japanese restaurants in Fresno with online delivery.",
"action_reprs": [
"[link] CITY PAGES -> CLICK",
"[link] Fresno -> CLICK",
"[img] -> CLICK",
"[span] Order Online -> CLICK",
"[link] All -> CLICK",
"[label] Japanese Restaurants -> CLICK",
"[button] Apply Filters -> CLICK"
]
},
{
"website": "carmax",
"id": "b7082615-e6e1-4981-b51b-9259671d1adf",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Change your store to the one nearest to 07055",
"action_reprs": [
"[span] Your store for 43219 -> CLICK",
"[searchbox] Enter ZIP or State -> CLICK",
"[searchbox] Enter ZIP or State -> TYPE: 07055",
"[button] Search for CarMax stores. -> CLICK",
"[button] set store -> CLICK"
]
},
{
"website": "carmax",
"id": "cdd9ef05-4d5b-4469-b001-8d73b6dc8120",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Find the documents required to sell a car in New Jersey for which payments are being paid and it has single person on the title who can come to the store",
"action_reprs": [
"[link] Sell/Trade -> CLICK",
"[combobox] In what state are you selling the car? -> SELECT: New Jersey",
"[radio] Yes -> CLICK",
"[radio] No -> CLICK",
"[radio] Yes -> CLICK",
"[button] WHAT TO BRING WITH YOU -> CLICK"
]
},
{
"website": "ebay",
"id": "a2b1d94b-5309-4c9b-bcdd-8048172af7b5",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Find an foldable over-ear headphone under 35 USD in certified refurbished condition with lowest price + shipping.",
"action_reprs": [
"[link] Electronics -> HOVER",
"[link] Headphones -> CLICK",
"[link] Ear-Cup (Over the Ear) -> CLICK",
"[button] Price -> CLICK",
"[link] Under $35.00 -> CLICK",
"[button] Condition -> CLICK",
"[link] Certified - Refurbished -> CLICK",
"[button] Sort: Best Match -> CLICK",
"[link] Price + Shipping: lowest first -> CLICK",
"[button] Features -> CLICK",
"[link] Foldable -> CLICK"
]
},
{
"website": "ebay",
"id": "a3bc6528-5fd5-45ac-81aa-7fafde757022",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Browse new laptops from $400 to $500 that offers free shippping.",
"action_reprs": [
"[combobox] Search for anything -> TYPE: laptop",
"[button] Search -> CLICK",
"[input] -> CLICK",
"[textbox] Minimum Value in $ -> TYPE: 400",
"[textbox] Maximum Value in $ -> TYPE: 500",
"[button] Submit price range -> CLICK",
"[input] -> CLICK"
]
},
{
"website": "ebay",
"id": "a8474730-82eb-4f12-b947-db64ac08660b",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Find the most recently posted job opening in customer service in Ireland with a remote working option.",
"action_reprs": [
"[link] Careers -> CLICK",
"[div] Discover jobs around the world -> CLICK",
"[ppc-content] Ireland -> CLICK",
"[button] Flexible Workstyles -> CLICK",
"[span] -> CLICK",
"[button] Category -> CLICK",
"[span] -> CLICK",
"[combobox] Sort by -> SELECT: Most recent"
]
},
{
"website": "budget",
"id": "d1de3d1a-3df1-4421-98f3-f8d078752893",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Book the cheapest cab with GPS and unlimited e-toll, and pay now for an option for a military veteran with pick up from the nearest location to Nevada City, California, on June 6, 11 am, and drop off at the exact location on June 10, 1 pm.",
"action_reprs": [
"[link] Military & Veterans -> CLICK",
"[textbox] Enter your pick-up location or zip code -> TYPE: nevada city",
"[span] Nevada City -> CLICK",
"[span] 4831 Granite Dr -> CLICK",
"[textbox] mm/dd/yyyy -> CLICK",
"[select] April 2023 -> SELECT: June 2023",
"[link] 6 -> CLICK",
"[combobox] Pick Up Time -> SELECT: 11:00 AM",
"[textbox] mm/dd/yyyy -> CLICK",
"[select] June 2023 -> SELECT: June 2023",
"[link] 10 -> CLICK",
"[combobox] Return Time -> SELECT: 1:00 PM",
"[button] Select My Car -> CLICK",
"[link] Pay Now -> CLICK",
"[checkbox] $14.45/Day$13.95/Day -> CLICK",
"[checkbox] $12.99/Day -> CLICK",
"[button] Continue -> CLICK"
]
},
{
"website": "budget",
"id": "e592a68f-567f-4d6a-a1d6-4166cd129638",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Find a truck for 10001 zip code on Sunday 11:30 am with flexible dates.",
"action_reprs": [
"[button] Reservations -> CLICK",
"[link] Budget Truck -> CLICK",
"[textbox] US City,State or Zip Code -> TYPE: 10001",
"[textbox] mm/dd/yyyy -> CLICK",
"[link] 23 -> CLICK",
"[input] -> CLICK",
"[span] -> CLICK",
"[button] Find Your Truck -> CLICK",
"[button] Select Truck -> CLICK"
]
},
{
"website": "newegg",
"id": "747429fa-7dac-4ab0-b604-13cb9bf787fe",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "Find the cheapest unused wireless Logitech Keyboard under $70.",
"action_reprs": [
"[searchbox] Search Site -> TYPE: wireless keyboard",
"[button] \uf002 -> CLICK",
"[span] New -> CLICK",
"[button] APPLY -> CLICK",
"[span] Logitech -> CLICK",
"[button] APPLY -> CLICK",
"[textbox] price to -> TYPE: 70",
"[button] APPLY -> CLICK",
"[combobox] Featured Items \uf0d7 -> SELECT: Lowest Price",
"[link] Logitech K120 Wired Keyboard for Windows, Plug and... -> CLICK"
]
},
{
"website": "nps.gov",
"id": "2a831fb6-3110-4ffb-8687-1d2acab09873",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Locate a park that has a campground and is located in the state of Colorado.",
"action_reprs": [
"[link] FIND A PARK -> CLICK",
"[link] Search by Activity or Topic -> CLICK",
"[combobox] By State -> SELECT: Colorado",
"[button] Activity -> CLICK",
"[input] -> CLICK",
"[button] Search -> CLICK"
]
},
{
"website": "nps.gov",
"id": "4132002e-5ba6-4e36-a1b7-6bbe61503be5",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find a living History event to attend in in April .",
"action_reprs": [
"[button] Open Menu -> CLICK",
"[button] All -> CLICK",
"[input] -> CLICK",
"[columnheader] \uf0da -> CLICK"
]
},
{
"website": "nps.gov",
"id": "612653f8-defe-41be-ae48-26ed859d98ca",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Locate Dry Tortugas in the state of Florida and find out the Current Conditions.",
"action_reprs": [
"[button] Find a Park by State -> CLICK",
"[link] Florida -> CLICK",
"[link] Current Conditions \u00bb -> CLICK"
]
},
{
"website": "nps.gov",
"id": "6eeaa528-88a8-416f-94f2-ae1425d9c4a3",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Search for a park in the state of California called Castle Mountains National Monument and find out it's Basic Information.",
"action_reprs": [
"[button] Find a Park by State -> CLICK",
"[link] California -> CLICK",
"[link] Basic Information \u00bb -> CLICK"
]
},
{
"website": "nps.gov",
"id": "6fd2a5e9-12e7-4f3c-bf1b-42702d56105e",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find a park in the National Park System that is related to the topics of Industry and also Laborer and Worker.",
"action_reprs": [
"[link] FIND A PARK -> CLICK",
"[link] Search by Activity or Topic -> CLICK",
"[button] Topic -> CLICK",
"[input] -> CLICK",
"[input] -> CLICK",
"[button] Search -> CLICK"
]
},
{
"website": "nps.gov",
"id": "7b5b2188-afd4-4279-b738-c37a1b5f2142",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find a list of available opportunities for a volunteer event for year 2023",
"action_reprs": [
"[button] Open Menu -> CLICK",
"[link] Volunteer -> CLICK",
"[link] Become a VIP and Volunteer with Us Today!\u203a -> CLICK",
"[link] volunteer event -> CLICK"
]
},
{
"website": "nps.gov",
"id": "7bdf34b4-2aa0-4387-9f6a-f7d7c5d17119",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find the alerts and conditions for the Alagnak Wild River.",
"action_reprs": [
"[link] FIND A PARK -> CLICK",
"[combobox] Park Name -> TYPE: Alagnak",
"[option] Alagnak Wild River -> CLICK",
"[link] ALERTS -> CLICK"
]
},
{
"website": "nps.gov",
"id": "83ada6a6-e264-4d98-9d48-7f97f87bab5d",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Browse the photo gallery of Acadia National Park.",
"action_reprs": [
"[button] Open Menu -> CLICK",
"[link] Photos & Multimedia -> CLICK",
"[link] NPGallery -> CLICK",
"[span] Search all Parks -> CLICK",
"[li] Acadia National Park -> CLICK",
"[button] \ue003 -> CLICK"
]
},
{
"website": "nps.gov",
"id": "8d7a29cf-7e66-4660-9b26-4eeba7c3f158",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Show me a list of children's program events in Illinois.",
"action_reprs": [
"[button] Open Menu -> CLICK",
"[link] Events -> CLICK",
"[button] All -> CLICK",
"[input] -> CLICK",
"[button] All -> CLICK",
"[label] Children\u2019s Program -> CLICK",
"[button] Search -> CLICK"
]
},
{
"website": "booking",
"id": "b73503a7-e4e1-43f7-bfc0-866e7003615f",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Reserve a taxi from O'hare Airport to 123 Main St, West Chicago, IL on Mar 29, 2023 at 12 noon for 2 adults.",
"action_reprs": [
"[span] Airport taxis -> CLICK",
"[textbox] Pick-up location -> TYPE: O'hare Airport",
"[heading] Chicago O'Hare International Airport -> CLICK",
"[textbox] Drop-off location -> TYPE: 123 Main St, West Chicago, IL",
"[heading] 123 Main St -> CLICK",
"[button] pickup date input field -> CLICK",
"[button] 29, March 2023 -> CLICK",
"[button] pickup time input field -> CLICK",
"[button] Confirm -> CLICK",
"[combobox] Passengers -> SELECT: 2",
"[button] Search -> CLICK",
"[button] Choose a standard-size taxi costing US$126.84 -> CLICK",
"[button] Continue to book -> HOVER"
]
},
{
"website": "booking",
"id": "c51cc2c0-5750-4bae-b665-ad1b7fafa63e",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Show ticket price for Aquarium of Paris for 2 adults on May 5th.",
"action_reprs": [
"[span] Attractions -> CLICK",
"[searchbox] Where are you going? -> TYPE: Aquarium of Paris",
"[div] Aquarium of Paris -> CLICK",
"[div] Select your dates -> CLICK",
"[checkbox] 5 May 2023 -> CLICK",
"[button] Search -> CLICK",
"[heading] Aquarium of Paris -> CLICK",
"[svg] -> CLICK",
"[svg] -> CLICK"
]
},
{
"website": "booking",
"id": "dfa415d9-efb2-4477-bc33-672f02d3399d",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Book a low-priced small air-conditioned car on rent in Mexico City Airport for under 100 dollars and book without insurance for next day.",
"action_reprs": [
"[span] Car rentals -> CLICK",
"[searchbox] Please type your destination -> TYPE: mexico city",
"[option] Mexico City - Benito Juarez Intl, MX (MEX) Mexico -> CLICK",
"[button] Search -> CLICK",
"[combobox] Sort by -> SELECT: Low to High",
"[span] -> CLICK",
"[span] -> CLICK",
"[span] -> CLICK",
"[span] -> CLICK",
"[div] View deal -> CLICK",
"[span] Go to book -> CLICK"
]
},
{
"website": "cargurus",
"id": "998e55fb-66d7-443f-bb73-9cb6a2bc26a8",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Find used BMW i3 for 10001 zip code with lowest price.",
"action_reprs": [
"[menuitem] Buy -> CLICK",
"[combobox] Select Make -> SELECT: BMW",
"[combobox] Select Model -> SELECT: i3",
"[textbox] Zip Code -> TYPE: 10001",
"[button] Search -> CLICK",
"[combobox] Select Sort Order -> SELECT: Lowest price first"
]
},
{
"website": "cargurus",
"id": "99b9a850-d5e3-4ecc-b1eb-99a5c5029918",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Show all used Tesla cars for 10017 zip code.",
"action_reprs": [
"[combobox] Select Make -> SELECT: Tesla",
"[textbox] Zip -> TYPE: 10017",
"[button] Search -> CLICK"
]
},
{
"website": "cargurus",
"id": "b1eb6602-3aa7-40ee-8968-69d83e7ef21c",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Find the newest silver-colored Lexus SUV with a black interior and backup camera to purchase which has been made between 2022-2023 and is within 50 miles of zip 10017.",
"action_reprs": [
"[menuitem] Buy -> HOVER",
"[menuitem] New Cars -> CLICK",
"[p] SUV / Crossover -> CLICK",
"[textbox] ZIP -> TYPE: 10017",
"[button] Search -> CLICK",
"[combobox] Select Minimum Year -> SELECT: 2022",
"[combobox] Select Maximum Year -> SELECT: 2023",
"[combobox] select-filter -> SELECT: 50 mi",
"[span] Silver -> CLICK",
"[p] Black -> CLICK",
"[p] Lexus -> CLICK",
"[p] Backup Camera -> CLICK",
"[combobox] Select Sort Order -> SELECT: Newest first (by car year)",
"[heading] New 2023 Lexus NX 350 AWD -> CLICK"
]
},
{
"website": "last.fm",
"id": "a747bed0-0f45-413a-8f48-2c45795e4e3d",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Give a like to the #1 track of the Real Time Top Chart",
"action_reprs": [
"[link] Charts -> CLICK",
"[gridcell] Like Crazy -> CLICK",
"[button] LOVE THIS TRACK -> CLICK"
]
},
{
"website": "last.fm",
"id": "a9708ad7-bec8-4435-b055-8ef6da520b8c",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Play the top track for the top indie artist in the last 30 days",
"action_reprs": [
"[link] Music -> CLICK",
"[link] indie -> CLICK",
"[link] The Smiths -> CLICK",
"[button] Sorted by: Last 7 days -> CLICK",
"[link] Last 30 days -> CLICK",
"[link] Play track -> CLICK"
]
},
{
"website": "last.fm",
"id": "b3c7e28e-00a2-4ef7-89c5-f3ad7efadd6a",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Show my Library and sort by Albums.",
"action_reprs": [
"[img] james9091 -> CLICK",
"[link] Library -> CLICK",
"[link] Albums -> CLICK"
]
},
{
"website": "last.fm",
"id": "b83120d9-5892-4e8f-b4b9-346cc07827a7",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Create a playlist and name it \"Dirty\" and add 5 Doja Cat songs.",
"action_reprs": [
"[img] james9091 -> CLICK",
"[link] Playlists -> CLICK",
"[link] NEW PLAYLIST -> CLICK",
"[button] START FROM SCRATCH -> CLICK",
"[h1] My New Playlist -> CLICK",
"[h1] My New Playlist -> TYPE: Dirty",
"[button] ADD TRACK -> CLICK",
"[textbox] Search -> TYPE: Doja Cat",
"[button] Search -> CLICK",
"[button] Add -> CLICK",
"[button] ADD TRACK -> CLICK",
"[textbox] Search -> TYPE: Doja Cat",
"[button] Search -> CLICK",
"[button] Add -> CLICK",
"[button] ADD TRACK -> CLICK",
"[textbox] Search -> CLICK",
"[textbox] Search -> TYPE: Doja Cat",
"[button] Search -> CLICK",
"[button] Add -> CLICK",
"[button] ADD TRACK -> CLICK",
"[textbox] Search -> TYPE: Doja Cat",
"[button] Search -> CLICK",
"[button] Add -> CLICK",
"[button] ADD TRACK -> CLICK",
"[textbox] Search -> TYPE: Doja Cat",
"[button] Search -> CLICK",
"[button] Add -> CLICK"
]
},
{
"website": "rei",
"id": "7a40f4c8-7aa6-4be4-abbe-24a0b511dc0e",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Search for hiking boots and filter the results to show only those with a waterproof rating of at least 3 stars.",
"action_reprs": [
"[button] Camp & Hike -> CLICK",
"[link] Hiking Footwear -> CLICK",
"[link] add filter: Waterproof(456) -> CLICK",
"[link] add filter: rating of 3-to-5 stars 371 -> CLICK"
]
},
{
"website": "budget",
"id": "03103341-f9d3-40a8-8435-f7946dd707b3",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Find the budget price for the vehicle with most seats availible at Roanoke Regional Airport from April 5-6.",
"action_reprs": [
"[textbox] Enter your pick-up location or zip code -> TYPE: Roanoke",
"[span] Roanoke Regional Airport -> CLICK",
"[button] Select My Car -> CLICK",
"[link] Price (Low to High) -> CLICK",
"[div] Sort by: -> CLICK",
"[link] Number of Seats (High to Low) -> CLICK",
"[link] Pay Now -> CLICK",
"[button] Continue -> CLICK"
]
},
{
"website": "budget",
"id": "03ac581c-ef95-4435-9d35-435e198b82de",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "View the Emergency Sickness Plan policy certificates for Connecticut.",
"action_reprs": [
"[button] Cars & Services -> CLICK",
"[link] Protections & Coverages -> CLICK",
"[heading] Emergency Sickness Plan (ESP) -> CLICK",
"[link] click here -> CLICK"
]
},
{
"website": "budget",
"id": "1655f54a-31e5-4dda-9089-7ccff35a1095",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Find the trip ideas for US travels and book small size or full-size pacific coast highway road trip for a Vietnamese from Los Angeles International Airport on July 7, 1 pm pick up and drop off at the same location on July 15, 2 pm.",
"action_reprs": [
"[link] Trip Ideas -> CLICK",
"[div] Pacific Coast Highway Road Trip -> CLICK",
"[textbox] Enter your pick-up location or zip code -> TYPE: LOS ANGELES",
"[span] Los Angeles Intl Airport -> CLICK",
"[textbox] mm/dd/yyyy -> CLICK",
"[select] April 2023 -> SELECT: July 2023",
"[link] 7 -> CLICK",
"[link] 15 -> CLICK",
"[combobox] Pick Up Time -> SELECT: 1:00 PM",
"[combobox] Return Time -> SELECT: 2:00 PM",
"[combobox] Select Residency -> SELECT: Vietnam",
"[generic] Vehicle Type * -> CLICK",
"[p] Small to Full Size -> CLICK",
"[button] Select My Car -> CLICK"
]
},
{
"website": "new.mta.info",
"id": "1ec300ff-d45f-495f-8fbe-36802fdd8c57",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find out about planned service changes on the 4 Subway on 5/3/2023.",
"action_reprs": [
"[svg] -> CLICK",
"[link] Planned Service Changes -> CLICK",
"[searchbox] Search Routes -> TYPE: 4",
"[listitem] 4 -> CLICK",
"[button] 04/12/2023 -> CLICK",
"[button] Next Month -> CLICK",
"[link] 3, Wednesday May 2023 -> CLICK"
]
},
{
"website": "new.mta.info",
"id": "26a20a7b-cd98-4752-a9ea-fcaebb3ab56e",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find information about how to buy metro card on booth.",
"action_reprs": [
"[link] Fares & Tolls -> CLICK",
"[div] Where to buy a MetroCard -> CLICK",
"[div] At a station booth -> CLICK"
]
},
{
"website": "new.mta.info",
"id": "351568c6-452d-4f32-9375-2b6301f0cb36",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "find the next available subway train to Grand central station, NY departing from Queensboro plaza station, Long Island, NY.",
"action_reprs": [
"[searchbox] From -> TYPE: Queensboro plaza",
"[listitem] Queensboro Plaza Station, Long Island City, NY, US... -> CLICK",
"[searchbox] To -> TYPE: Grand Central, NY",
"[listitem] Grand Central Terminal, East 42nd Street, New York... -> CLICK",
"[button] Open Travel Preferences modal. -> CLICK",
"[label] Bus -> CLICK",
"[label] Express Bus -> CLICK",
"[label] Rail -> CLICK",
"[button] Done button - Press enter key to submit travel pre... -> CLICK",
"[link] Plan my Trip - Press enter key to submit the form ... -> CLICK"
]
},
{
"website": "new.mta.info",
"id": "3a85b415-9e68-4cf0-91be-386d4d8f0710",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "download pdf for list of accessible station in NYC.",
"action_reprs": [
"[span] Menu -> CLICK",
"[link] Accessibility -> CLICK",
"[div] List of Accessible Stations -> CLICK",
"[link] Download a PDF short list of accessible stations. -> CLICK"
]
},
{
"website": "new.mta.info",
"id": "3e9d6144-e92b-4fb0-b634-48bf3eb5090b",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Plan a trip from Greenport to Oyster Bay Branch, starting with train and ending via bus with less than 1/2 mile walk.",
"action_reprs": [
"[searchbox] From -> TYPE: Greenport",
"[listitem] Greenport, NY, USA -> CLICK",
"[searchbox] To -> TYPE: Oyster Bay",
"[listitem] Oyster Bay, NY, USA -> CLICK",
"[button] Open Travel Preferences modal. -> CLICK",
"[combobox] Start Journey -> SELECT: Train",
"[combobox] End Journey -> SELECT: Bus",
"[button] Done button - Press enter key to submit travel pre... -> CLICK",
"[link] Plan my Trip - Press enter key to submit the form ... -> CLICK"
]
},
{
"website": "new.mta.info",
"id": "50f1e384-4b63-4827-a670-cd19f5a2c710",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "find schedule for Long Island Rail Road & Metro-North Railroad from Bay Shore to Breakneck Ridge on Thu, Mar 23, 08:37 AM.",
"action_reprs": [
"[link] Schedules -> CLICK",
"[searchbox] From -> TYPE: Bay Shore",
"[listitem] Bay Shore -> CLICK",
"[searchbox] To -> TYPE: Breakneck ridge",
"[span] Breakneck Ridge -> CLICK",
"[button] 03/18/2023 -> CLICK",
"[link] 23, Thursday March 2023 -> CLICK",
"[select] 1 -> SELECT: 8",
"[select] 00 -> SELECT: 37",
"[select] AM -> SELECT: AM",
"[link] Find Schedules -> CLICK"
]
},
{
"website": "new.mta.info",
"id": "62c5067e-daff-4af6-bd79-83f6a969f4d6",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Get details of the fastest trip between 52nd Street,Brooklyn and 74th Street, Brooklyn, leaving now, that is accessible for a disabled person.",
"action_reprs": [
"[searchbox] From -> TYPE: 52nd street, brooklyn",
"[listitem] 52nd Street, Brooklyn, NY, USA -> CLICK",
"[searchbox] To -> TYPE: 74th street, brooklyn",
"[listitem] 74th Street, Brooklyn, NY, USA -> CLICK",
"[label] Accessible Trip -> CLICK",
"[link] Plan my Trip - Press enter key to submit the form ... -> CLICK",
"[tab] Fastest -> CLICK",
"[tab] Fastest -> CLICK"
]
},
{
"website": "gamestop",
"id": "a3fc5023-1198-4c17-8c1f-45780ab7f3bd",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Search for the latest deluxe digital copy of the Xbox Series X Resident Evil game for pre-order and add it to the cart.",
"action_reprs": [
"[searchbox] Search games, consoles & more -> TYPE: resident evil",
"[span] resident evil -> CLICK",
"[link] Filter -> CLICK",
"[generic] Refine by Category: Video Games -> CLICK",
"[generic] Refine by Category: Xbox Series X|S -> CLICK",
"[link] Shop Pre-Orders -> CLICK",
"[button] Franchise -> CLICK",
"[checkbox] Resident Evil Resident Evil -> CLICK",
"[button] Done -> CLICK",
"[heading] Resident Evil 4 - Xbox Series X -> CLICK",
"[span] Digital -> CLICK",
"[li] Deluxe -> CLICK",
"[button] Add to Cart -> CLICK"
]
},
{
"website": "imdb",
"id": "60e1de47-efdb-47e8-935f-2ac38af1ead3",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Add Prometheus movie to watchlist.",
"action_reprs": [
"[textbox] Search IMDb -> CLICK",
"[textbox] Search IMDb -> TYPE: Prometheus",
"[div] Prometheus -> CLICK",
"[button] Add to Watchlist Added by 412K users -> CLICK"
]
},
{
"website": "imdb",
"id": "6c107328-3ff6-4cb3-af16-5f9ca447fd66",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Add documentary \"The Elephant Whisperers\" and \"The Magician's Elephant\" to the watchlist.",
"action_reprs": [
"[textbox] Search IMDb -> TYPE: The Elephant Whisperers",
"[div] The Elephant Whisperers -> CLICK",
"[div] Add to Watchlist -> CLICK",
"[textbox] Search IMDb -> TYPE: The Magician's Elephant",
"[div] The Magician's Elephant -> CLICK",
"[div] Add to Watchlist -> CLICK"
]
},
{
"website": "imdb",
"id": "6f1fe14d-543a-43c6-964a-0c74f6d86091",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Show me movies produced by Aaron Horvath.",
"action_reprs": [
"[textbox] Search IMDb -> TYPE: Aaron Horvath",
"[div] Aaron Horvath -> CLICK",
"[button] Expand Previous -> CLICK"
]
},
{
"website": "sports.yahoo",
"id": "673841c2-de8c-4417-bdcc-dc48753a539f",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "check the current standings for the western conference in the NBA and find the top team.",
"action_reprs": [
"[link] NBA . -> HOVER",
"[link] Standings . -> CLICK",
"[link] Denver - y -> CLICK"
]
},
{
"website": "sports.yahoo",
"id": "92b51ef3-7b37-4423-aa6b-e8fb6bf32156",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "search for news about the latest news about Lebron James' injury and share the article on twitter.",
"action_reprs": [
"[combobox] Search query -> TYPE: lebron james",
"[img] LeBron James -> CLICK",
"[link] News -> CLICK",
"[button] Social media share article menu -> CLICK",
"[link] Share article on Twitter -> CLICK"
]
},
{
"website": "sports.yahoo",
"id": "94bd2a0f-fe08-4420-a0e8-d48248630b6e",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Find the Leaderboard for the top 10 fantasy Basketball players for the Rotisserie challenge.",
"action_reprs": [
"[link] Fantasy . -> CLICK",
"[link] Fantasy Basketball -> CLICK",
"[link] Leaders -> CLICK"
]
},
{
"website": "agoda",
"id": "fca09c13-5e6c-49d5-b3ee-b620a70b19f5",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Find a hotel with lowest price in Tokyo for 2 adults and 1 child for 10 May and checkout on 12.",
"action_reprs": [
"[combobox] Enter a destination or property -> TYPE: Tokyo",
"[option] Top destination Tokyo, Japan (City) -> CLICK",
"[div] 10 -> CLICK",
"[span] 12 -> CLICK",
"[img] Add -> CLICK",
"[span] SEARCH -> CLICK",
"[span] SEARCH -> CLICK",
"[tab] Lowest price first -> CLICK",
"[heading] Nice Hostel Kameari -> CLICK"
]
},
{
"website": "agoda",
"id": "fe6b5531-ce29-4ba1-8e98-43b5fecf57fa",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Find a cheapest flight from London to New York on 9th May.",
"action_reprs": [
"[tab] Flights -> CLICK",
"[combobox] Flying from -> TYPE: London",
"[option] Destination London -> CLICK",
"[combobox] Flying to -> TYPE: New York",
"[option] Destination New York (NY) -> CLICK",
"[span] 9 -> CLICK",
"[button] SEARCH FLIGHTS -> CLICK",
"[span] Price per person -> CLICK",
"[p] Cheapest first -> CLICK",
"[div] Economy Light -> CLICK",
"[button] SELECT -> CLICK"
]
},
{
"website": "sixflags",
"id": "5b56d5b8-1f41-43ca-9f21-369d849f1aa0",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Browse the season pass prices for Hurricane HarborLos Angeles.",
"action_reprs": [
"[span] Hurricane Harbor Los Angeles -> CLICK",
"[button] Go! -> CLICK",
"[link] Tickets & Passes \uf078 -> CLICK",
"[link] Tickets & Passes -> CLICK"
]
},
{
"website": "sixflags",
"id": "607cea69-abb5-4055-aa09-117650cb7cc9",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Request information for tickets for a group of 100 people at a park in california",
"action_reprs": [
"[button] Browse the Parks Below -> CLICK",
"[span] Six Flags Magic Mountain -> CLICK",
"[button] Go! -> CLICK",
"[link] Groups \ue92e -> CLICK",
"[i] -> CLICK",
"[button] Request Information -> CLICK"
]
},
{
"website": "carmax",
"id": "0790c8be-6e6d-4e2a-9c13-43ac9367da4c",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "search the most recent full time Accounting & Finance Job available in Richmond, Virginia.",
"action_reprs": [
"[button] Open helpful links menu -> CLICK",
"[link] Search jobs at CarMax -> CLICK",
"[textbox] Search for Job title -> TYPE: Accounting",
"[link] Accounting & Finance 7 jobs -> CLICK",
"[button] State -> CLICK",
"[span] Virginia -> CLICK",
"[button] City -> CLICK",
"[span] Richmond -> CLICK"
]
},
{
"website": "carmax",
"id": "10e17667-f9cf-4a68-adcd-ad2677c3f385",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Find series 1 and series 2 BMW vehicles in the store nearest to 07055",
"action_reprs": [
"[link] SEARCH CARS -> CLICK",
"[div] Best match -> CLICK",
"[label] Nearest distance -> CLICK",
"[button] Back to all categories -> CLICK",
"[button] Distance & Shipping -> CLICK",
"[button] Change Location -> CLICK",
"[textbox] Enter ZIP or State -> CLICK",
"[textbox] Enter ZIP or State -> TYPE: 07055",
"[button] Set My Store -> CLICK",
"[button] set store -> CLICK",
"[button] Make -> CLICK",
"[span] (954) -> CLICK",
"[button] Back to all categories -> CLICK",
"[button] Series -> CLICK",
"[listitem] 1-SERIES (8) 1-SERIES (8) -> CLICK",
"[listitem] 2-SERIES (5) 2-SERIES (5) -> CLICK"
]
},
{
"website": "new.mta.info",
"id": "e5c228ff-7834-46d2-b906-dcea21a0c477",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find the subway station nearest to 07055",
"action_reprs": [
"[span] Nearby Stations & Stops -> CLICK",
"[searchbox] Address, station, landmark -> CLICK",
"[searchbox] Address, station, landmark -> TYPE: 07055",
"[listitem] Passaic, NJ 07055, USA -> CLICK"
]
},
{
"website": "newegg",
"id": "05c4da5b-263d-40a4-9982-6cf6311b57a1",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "Find an Xbox Wireless controller rated above 4 stars.",
"action_reprs": [
"[searchbox] Search Site -> TYPE: xbox wireless controller",
"[button] \uf002 -> CLICK",
"[dt] Customer Ratings -> CLICK",
"[div] & up -> CLICK",
"[button] APPLY -> CLICK",
"[img] Wired Gaming Controller, Joystick Gamepad with Dua... -> CLICK"
]
},
{
"website": "carnival",
"id": "eab97f0c-38b3-4421-bff6-697b3267f23c",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find carnival cruise options that include Alaska.",
"action_reprs": [
"[button] SAIL TO -> CLICK",
"[button] Alaska -> CLICK",
"[button] SEARCH CRUISES -> CLICK"
]
},
{
"website": "carnival",
"id": "fb04bb83-9ad5-4186-a0da-17af9ba2a63d",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find offers for VIFP Club loyalty number 9016467685 and show the ones that are for members only.",
"action_reprs": [
"[button] Manage -> HOVER",
"[use] -> CLICK",
"[link] Visit our cruise deals page to view your offers -> CLICK",
"[button] Show My Deals -> CLICK",
"[link] VIFP Club Members-Only Offers (2) -> CLICK"
]
},
{
"website": "resy",
"id": "92869590-839d-4dfd-8884-4c52bef3b328",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Find a pasta restaurant in Sydney and save it",
"action_reprs": [
"[button] Location Columbus, OH -> CLICK",
"[button] Sydney -> CLICK",
"[textbox] Search restaurants, cuisines, etc. -> TYPE: pasta",
"[textbox] Search restaurants, cuisines, etc. -> ENTER",
"[path] -> CLICK"
]
},
{
"website": "resy",
"id": "ab1ae27a-029c-4f0c-9e01-82715e08d518",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Book the tables at Chianti - MG Road restaurant on March 30,1:30 PM for 4 Guests.",
"action_reprs": [
"[textbox] Search restaurants, cuisines, etc. -> TYPE: CHIANTI",
"[combobox] Guests -> SELECT: 4 Guests",
"[button] March 30, 2023. Selected date. -> CLICK",
"[button] 1:30 PM Dining Room -> CLICK",
"[button] Reserve Now -> HOVER"
]
},
{
"website": "resy",
"id": "b1055658-7993-448c-9af6-a722cf69ff97",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Make a reservation for the next restaurant-related event, only 1 ticket is needed.",
"action_reprs": [
"[link] See more venues in the Special Events &amp; Experi... -> CLICK",
"[link] HAPPY HOUR BURGER, Aria, Thursday, April 13, 2023 ... -> CLICK",
"[combobox] 2 tickets for HAPPY HOUR BURGER -> SELECT: 1 Ticket",
"[button] 5:00 PM -> CLICK",
"[button] Reserve Now -> CLICK"
]
},
{
"website": "rottentomatoes",
"id": "18a581b9-5021-40aa-835d-3c8110402df3",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Find adventure movies coming to theaters.",
"action_reprs": [
"[link] MOVIES -> HOVER",
"[link] Coming soon to theaters -> CLICK",
"[span] Genre -> CLICK",
"[div] -> CLICK",
"[button] APPLY -> CLICK"
]
},
{
"website": "rottentomatoes",
"id": "1ed913ba-62a3-4214-a947-217b74c4b8f7",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "List upcoming animation and anime movies in theaters",
"action_reprs": [
"[link] MOVIES -> CLICK",
"[button] IN THEATERS -> CLICK",
"[link] COMING SOON -> CLICK",
"[span] Genre -> CLICK",
"[div] -> CLICK",
"[div] -> CLICK",
"[button] APPLY -> CLICK"
]
},
{
"website": "newegg",
"id": "51d2bb04-8207-4c21-8bc3-c00d826a5d0c",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "Remove the SSD on my cart",
"action_reprs": [
"[link] Shopping Cart -> CLICK",
"[button] trash REMOVE -> CLICK"
]
},
{
"website": "spothero",
"id": "5f9182dc-d35d-4c0e-9abe-cd913c136528",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find career openings in the marketing department",
"action_reprs": [
"[link] Careers -> CLICK",
"[tab] Marketing (2) -> CLICK"
]
},
{
"website": "spothero",
"id": "6b627cbc-a45e-4f7e-9d02-bfca1a41070a",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "View details for a Times Square parking lot that is wheelchair accessible.",
"action_reprs": [
"[textbox] Search for parking -> TYPE: Times Square",
"[li] Times Square, New York, NY, USA -> CLICK",
"[button] Filter -> CLICK",
"[checkbox] Wheelchair Accessible (12) -> CLICK",
"[button] Show 12 Results -> CLICK"
]
},
{
"website": "spothero",
"id": "749dfeeb-8293-4c25-9cad-84f1a93f165d",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find EV charging supported parking closest to Smithsonian museum on Apr 9 between 9am to 6pm",
"action_reprs": [
"[textbox] Search for parking -> TYPE: Smithsonian",
"[li] Smithsonian National Air and Space Museum, Indepen... -> CLICK",
"[button] Filter -> CLICK",
"[checkbox] EV Charging (1) -> CLICK",
"[button] Show 1 Results -> CLICK",
"[textbox] Start Date -> CLICK",
"[gridcell] Sun Apr 09 2023 -> CLICK",
"[combobox] Start Time -> SELECT: 9:00 AM",
"[combobox] End Time -> SELECT: 6:00 PM",
"[button] Update Search -> CLICK",
"[select] Sort by Distance -> SELECT: Sort by Distance"
]
},
{
"website": "spothero",
"id": "77be98ff-e4db-4745-9b87-6ce69754c4c2",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find the cheapest wheelchair accessible parking for the Pittsburgh Pirates at St. Louis Cardinals event in Busch Stadium on Apr 13.",
"action_reprs": [
"[textbox] Search for parking -> TYPE: busch stadium",
"[li] Busch Stadium, Clark Avenue, St. Louis, MO, USA -> CLICK",
"[p] Pittsburgh Pirates at St. Louis Cardinals -> CLICK",
"[button] Filter -> CLICK",
"[checkbox] Wheelchair Accessible (10) -> CLICK",
"[button] Show 10 Results -> CLICK",
"[select] Sort by Distance -> SELECT: Sort by Price"
]
},
{
"website": "spothero",
"id": "839ad551-da04-4c8e-96c3-093e762ea167",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Search and book the cheapest daytime only monthly parking option in Seattle near Stripe, 5th Avenue",
"action_reprs": [
"[textbox] Search for parking -> TYPE: stripe, 5th avenue",
"[li] Stripe, 5th Avenue, Seattle, WA, USA -> CLICK",
"[tab] Monthly -> CLICK",
"[select] All Parking Options -> SELECT: Daytime Only Parking",
"[select] Sort by Distance -> SELECT: Sort by Price",
"[heading] 335 Columbia St. - MOTORCYCLE PARKING ONLY -> CLICK",
"[button] Proceed to Checkout -> CLICK"
]
},
{
"website": "spothero",
"id": "87989b8e-0b6a-4dbe-a8bf-6adc2bdf3c29",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Book an hourly parking at Atlanta International Airport.",
"action_reprs": [
"[tab] Hourly -> CLICK",
"[textbox] Search for parking -> TYPE: Atlanta International Airport",
"[li] Atlanta International Airport, Spine Road, College... -> CLICK",
"[button] Book Now -> CLICK"
]
},
{
"website": "spothero",
"id": "a2959cdb-fbc4-435f-ba89-85d50d22298c",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find parking spaces in JFK airport between April 18-20 that have lowest shuttle times",
"action_reprs": [
"[tab] Airport -> CLICK",
"[searchbox] Airport Name, Code or City -> TYPE: jfk",
"[li] John F. Kennedy International Airport (JFK) -> CLICK",
"[textbox] Parking Start Date -> CLICK",
"[gridcell] Tue Apr 18 2023 -> CLICK",
"[gridcell] Thu Apr 20 2023 -> CLICK",
"[select] Featured -> SELECT: Shuttle Time"
]
},
{
"website": "spothero",
"id": "b5de73d0-820d-45bf-8989-1743a0d9b072",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Book the closest parking spot to the Orlando Magic at Brooklyn Nets event, happening in Barclays Center, to enter after 3 pm and exit after 5 pm",
"action_reprs": [
"[textbox] Search for parking -> TYPE: barclays center",
"[li] Barclays Center, Atlantic Avenue, Brooklyn, NY, US... -> CLICK",
"[p] Orlando Magic at Brooklyn Nets -> CLICK",
"[select] Sort by Distance -> SELECT: Sort by Distance",
"[combobox] Start Time -> SELECT: 3:00 PM",
"[combobox] End Time -> SELECT: 5:00 PM",
"[button] Update Search -> CLICK",
"[button] Book Now -> CLICK"
]
},
{
"website": "amtrak",
"id": "3cb44998-5a0c-44c5-84b7-ffb729a356d8",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find the schedule between New York and Washington DC sorted by shortest trip.",
"action_reprs": [
"[textbox] From -> TYPE: New York",
"[option] New York, NY - Moynihan Train Hall at Penn Sta. (N... -> CLICK",
"[textbox] To -> TYPE: Washington",
"[option] Washington, DC - Union Station (WAS) -> CLICK",
"[textbox] Depart Date -> CLICK",
"[gridcell] Monday, April 17, 2023 -> CLICK",
"[button] FIND TRAINS -> CLICK",
"[span] Sort/Filter -> CLICK",
"[span] Shortest Trip -> CLICK"
]
},
{
"website": "ticketcenter",
"id": "2177b546-5718-478b-8535-bc37975b0d0c",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Book 2 hot seat VIP tickets through email id adelefan@hotmail.com for Adele's concert in Las Vegas on the last weekend of June.",
"action_reprs": [
"[textbox] Search for artists, teams or venues... -> TYPE: adele",
"[option] Adele -> CLICK",
"[link] TICKETS -> CLICK",
"[div] Quantity -> CLICK",
"[label] 2 -> CLICK",
"[button] $3,535/ea -> CLICK",
"[textbox] *Email Address -> TYPE: adelefan@hotmail.com",
"[button] Proceed to Payment -> CLICK"
]
},
{
"website": "newegg",
"id": "8368b990-c6ca-4cfe-a7ab-c2a88697639d",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "Build a PC with Intel i9 Raptor Lake 24 cores, Asus ROG strix Z790 motherboard, Asus TUF Rtx 4090 and remaining all compatible products with SSD.",
"action_reprs": [
"[generic] Site Menu -> CLICK",
"[link] icon of Build Your Own Custom PC Build Your Own Cu... -> CLICK",
"[link] \ue902 CPU -> CLICK",
"[button] START A NEW BUILD -> CLICK",
"[button] \uf067 SELECT -> CLICK",
"[button] \uf067 SELECT -> CLICK",
"[button] \uf067 SELECT -> CLICK",
"[button] \uf067 SELECT -> CLICK",
"[button] \uf067 SELECT -> CLICK",
"[button] \uf067 SELECT -> CLICK",
"[button] \uf067 SELECT -> CLICK",
"[button] \uf067 SELECT -> CLICK",
"[button] \uf067 SELECT -> CLICK",
"[button] \uf067 SELECT -> CLICK",
"[button] \uf067 SELECT -> CLICK",
"[button] \uf067 SELECT -> CLICK",
"[link] SSD Storage -> CLICK",
"[button] \uf067 SELECT -> CLICK",
"[button] \uf067 SELECT -> CLICK",
"[link] Fan & Heatsink CPU Cooler -> CLICK",
"[button] \uf067 SELECT -> CLICK",
"[button] \uf067 SELECT -> CLICK",
"[button] \uf067 SELECT -> CLICK",
"[button] \uf067 SELECT -> CLICK",
"[link] Gaming Monitors Accessories -> CLICK",
"[button] \uf067 SELECT -> CLICK",
"[button] SAVE LIST -> CLICK"
]
},
{
"website": "apple",
"id": "d743815d-b7be-43c5-99b6-a224bd2f6a1e",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "Show information on how to find lost AirPods.",
"action_reprs": [
"[link] Support -> CLICK",
"[img] -> CLICK",
"[span] Find My AirPods -> CLICK"
]
},
{
"website": "apple",
"id": "fd2494f3-fe7d-4c58-81e4-742c72b4e1f2",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "Check the order status using an order number of24124124091. The email address is boobear@gmail.com",
"action_reprs": [
"[link] Store -> HOVER",
"[link] Order Status -> CLICK",
"[textbox] Order number -> TYPE: 24124124091",
"[textbox] Email address -> TYPE: boobear@gmail.com",
"[button] Continue -> CLICK"
]
},
{
"website": "target",
"id": "80e12375-19ad-400f-9e35-2a3853173bed",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Shop for the same-day delivery of thin crust frozen pepperoni pizza and add 2 packets to the cart.",
"action_reprs": [
"[link] Categories -> CLICK",
"[link] Grocery -> CLICK",
"[span] Frozen Foods -> CLICK",
"[span] Frozen Pizza -> CLICK",
"[button] Type -> CLICK",
"[div] -> CLICK",
"[button] close -> CLICK",
"[button] Flavor -> CLICK",
"[div] -> CLICK",
"[button] close -> CLICK",
"[button] Pizza Crust Type -> CLICK",
"[div] -> CLICK",
"[button] close -> CLICK",
"[heading] Same Day Delivery -> CLICK",
"[link] Self-Rising Crust Uncured Pepperoni Frozen Pizza -... -> CLICK",
"[svg] -> CLICK",
"[link] 2 -> CLICK",
"[button] Add to cart for Self-Rising Crust Uncured Pepperon... -> CLICK"
]
},
{
"website": "ticketcenter",
"id": "c55b9949-b785-4d9e-8b20-b626cb595623",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Show me events in Phoenix for the next 3 days.",
"action_reprs": [
"[button] CITY GUIDES -> HOVER",
"[link] Phoenix -> CLICK",
"[button] All dates -> CLICK",
"[link] Next 3 days -> CLICK"
]
},
{
"website": "ticketcenter",
"id": "d1e46885-62b3-42ae-837a-474b1541348a",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Find parking passes for New York Yankees game on April 14",
"action_reprs": [
"[textbox] Search for artists, teams or venues... -> CLICK",
"[textbox] Search for artists, teams or venues... -> TYPE: New york yankees",
"[option] New York Yankees -> CLICK",
"[link] TICKETS -> CLICK",
"[div] More Options -> CLICK",
"[span] Parking Passes -> CLICK",
"[button] Done -> CLICK"
]
},
{
"website": "ticketcenter",
"id": "d7631fa2-ce46-4e20-a043-71ce70627c46",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Browse hip hop concerts that are happening this weekend.",
"action_reprs": [
"[button] CONCERTS -> CLICK",
"[link] Rap / Hip Hop -> CLICK",
"[button] All dates -> CLICK",
"[link] This weekend -> CLICK"
]
},
{
"website": "ticketcenter",
"id": "da800367-eeab-478b-bcf2-e6d4106591d2",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Find events in Lubbock, Texas during next 7 days",
"action_reprs": [
"[textbox] Search for artists, teams or venues... -> CLICK",
"[textbox] Search for artists, teams or venues... -> TYPE: Lubbock, Texas",
"[button] Search -> CLICK",
"[button] All dates -> CLICK",
"[link] Next 7 days -> CLICK"
]
},
{
"website": "ticketcenter",
"id": "f3850ec8-bf7c-42c3-9469-457836914f77",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Find tickets for events in Boston.",
"action_reprs": [
"[button] CITY GUIDES -> HOVER",
"[link] Boston -> CLICK"
]
},
{
"website": "ticketcenter",
"id": "fb73611b-dc68-4a75-bf5b-7e151dc151af",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Get tickets for the Buckeyes football game on April 15th for a group of 5 people.",
"action_reprs": [
"[link] BUY TICKETS -> CLICK",
"[span] -> CLICK",
"[label] 5 -> CLICK",
"[button] $28/ea -> CLICK"
]
},
{
"website": "carnival",
"id": "d4f7da1f-2ed8-4110-8dea-35f07b7a1756",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Begin booking a 14 day cruise from Los Angeles to Hawaii",
"action_reprs": [
"[span] Sail To -> CLICK",
"[button] Hawaii -> CLICK",
"[button] SAIL FROM -> CLICK",
"[button] Los Angeles, CA -> CLICK",
"[button] SEARCH CRUISES -> CLICK",
"[path] -> CLICK",
"[link] START BOOKING Best Price Sun - Sun, Jan 12 to 26 -> CLICK"
]
},
{
"website": "carnival",
"id": "e62d1f6c-d98c-4ea2-b699-527eeedf3e9b",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Order an adult\u2019s bottomless bubbles package for Joe Bloggs who is booked onto cruise 101010",
"action_reprs": [
"[link] Beverage Packages -> CLICK",
"[img] -> CLICK",
"[link] Beverage Packages -> CLICK",
"[button] add Bottomless Bubbles to the cart with price $9.5... -> CLICK",
"[div] I want to give a gift to a booked cruiser -> CLICK",
"[textbox] first-name -> TYPE: Joe",
"[textbox] last-name -> TYPE: Bloggs",
"[textbox] booking-number -> TYPE: 101010",
"[button] save details and continue -> CLICK"
]
},
{
"website": "kbb",
"id": "56cac423-4be9-4f74-9031-7cef1fe60ef9",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Find the fuel economy for a 2005 Toyota Corolla",
"action_reprs": [
"[link] Price New/Used -> CLICK",
"[combobox] Year -> SELECT: 2005",
"[combobox] Make -> SELECT: Toyota",
"[combobox] Model -> SELECT: Corolla",
"[button] Next -> CLICK",
"[button] Close dialog -> CLICK"
]
},
{
"website": "carmax",
"id": "e104a4ef-521f-4ca0-8e1a-098656207de2",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Find estimated monthly payments for a $10,000 vehicle with $500 down payment, 72 month term length and challenged credit score in the state of New Jersey",
"action_reprs": [
"[link] Finance -> CLICK",
"[link] Car payment calculator -> CLICK",
"[textbox] Vehicle Price -> CLICK",
"[textbox] Vehicle Price -> TYPE: 10000",
"[textbox] Down Payment -> CLICK",
"[textbox] Down Payment -> TYPE: 500",
"[combobox] State -> SELECT: New Jersey",
"[combobox] Credit Score -> SELECT: Challenged (< 580 FICO\u00ae Score)",
"[combobox] Term Length -> SELECT: 72 months"
]
},
{
"website": "seatgeek",
"id": "563ec938-b259-45b7-b0d3-6360b74e601d",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "check 2 of WrestleMania single day Parking Passes on April 1st in California near LA.",
"action_reprs": [
"[div] Sports -> HOVER",
"[link] WWE -> HOVER",
"[link] Wrestlemania -> CLICK",
"[link] Parking -> CLICK",
"[span] From $62 -> CLICK",
"[button] Quantity -> CLICK",
"[span] 2 Tickets -> CLICK"
]
},
{
"website": "seatgeek",
"id": "6760de22-dc0e-4b29-916f-a6a78f2c0551",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Find parking prices for upcoming Los Angeles Lakers games.",
"action_reprs": [
"[div] Sports -> HOVER",
"[link] NBA -> HOVER",
"[link] Los Angeles Lakers -> CLICK",
"[link] Parking -> CLICK"
]
},
{
"website": "seatgeek",
"id": "74226fab-6285-45da-8582-d25a876aa7b0",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Find tickets for the next pop concert.",
"action_reprs": [
"[link] Music -> HOVER",
"[a] Genres -> HOVER",
"[link] Pop -> CLICK"
]
},
{
"website": "seatgeek",
"id": "78915162-53c9-4cb1-86e1-6be6047528e0",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Find out if Coldplay is playing any events in Columbus, OH on May 17.",
"action_reprs": [
"[textbox] Search by team, artist, event or venue -> CLICK",
"[textbox] Search by team, artist, event or venue -> TYPE: Coldplay",
"[paragraph] Coldplay -> CLICK",
"[button] Filter by\u00a0Date -> CLICK",
"[button] Next month -> CLICK",
"[div] 17 -> CLICK",
"[button] Apply -> CLICK"
]
},
{
"website": "yellowpages",
"id": "a3edc9c7-397d-478b-a0b9-0ffa0897acca",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Search for person named John Smith in New York.",
"action_reprs": [
"[link] Find People -> CLICK",
"[input] -> TYPE: John",
"[input] -> TYPE: Smith",
"[input] -> TYPE: New York",
"[button] Search for Someone -> CLICK"
]
},
{
"website": "yellowpages",
"id": "a6fc427d-c2fd-4f1b-8f7d-8bb8647e63e9",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Find deals in New York.",
"action_reprs": [
"[a] City Pages -> CLICK",
"[link] New York -> CLICK",
"[link] New York Coupons & Deals -> CLICK"
]
},
{
"website": "yellowpages",
"id": "b3fbf029-aa63-4dd1-879f-47d8abbae4d4",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Find an attorney for divorce in Union City, NJ.",
"action_reprs": [
"[link] Attorneys -> CLICK",
"[input] -> TYPE: Union City Nj",
"[link] Union City, NJ -> CLICK",
"[button] Find -> CLICK",
"[link] All -> CLICK",
"[label] Divorce -> CLICK",
"[button] Apply Filters -> CLICK",
"[link] Law Offices Alan Molina -> CLICK"
]
},
{
"website": "menards",
"id": "4775a0e3-3dad-46f2-b719-b1c0dae9e147",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find tortillas bread in grocery stock near zip 59901 and add 5 pieces of 12 pcs pack in the cart and view the cart.",
"action_reprs": [
"[button] COLUMBUS, OH -> CLICK",
"[textbox] Zip Code -> TYPE: 59901",
"[button] Search By Zip Code -> CLICK",
"[button] MAKE MY STORE -> CLICK",
"[button] Departments -> HOVER",
"[button] Grocery & Home -> HOVER",
"[link] Grocery -> CLICK",
"[link] Bread -> CLICK",
"[label] In Stock Today -> CLICK",
"[checkbox] Tortillas (4) -> CLICK",
"[button] Increase Quantity -> CLICK",
"[button] Increase Quantity -> CLICK",
"[button] Increase Quantity -> CLICK",
"[button] Increase Quantity -> CLICK",
"[button] ADD TO CART -> CLICK",
"[button] VIEW CART -> CLICK"
]
},
{
"website": "menards",
"id": "78e346d2-3c80-4243-b921-ed35c4c4d923",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Track an order using the order number of 456481897 and phone number of 8984486417.",
"action_reprs": [
"[link] Order Tracker -> CLICK",
"[textbox] Order number EXAMPLES: ECEA12345, 01234567 -> TYPE: 456481897",
"[textbox] Email or Phone Number (associated with Order) -> TYPE: 898-448-6474",
"[button] SEARCH -> CLICK"
]
},
{
"website": "budget",
"id": "0245df99-2909-465a-861e-7fbca948e82f",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Show car guide info for economy car and reserve.",
"action_reprs": [
"[button] Cars & Services -> CLICK",
"[link] Car Guides -> CLICK",
"[link] Vehicle Info -> CLICK",
"[link] Reserve -> CLICK"
]
},
{
"website": "marriott",
"id": "b49f0d3e-7047-41df-9b4f-c2c15b1d3f70",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Find The Ritz-Carlton hotels in Washington DC that can hold a student social event from May 9 to May 12 and will require 7 guest rooms and an event space for 50",
"action_reprs": [
"[button] Meetings & Events -> CLICK",
"[link] Group Travel -> CLICK",
"[link] Group Travel for Students -> CLICK",
"[textbox] Destination -> TYPE: washington",
"[menuitem] Washington D.C., DC, USA -> CLICK",
"[textbox] Start Date -> CLICK",
"[button] \ue023 -> CLICK",
"[gridcell] Tue, May 9, 2023 -> CLICK",
"[gridcell] Fri, May 12, 2023 -> CLICK",
"[div] Purpose of your event -> CLICK",
"[li] Social -> CLICK",
"[textbox] Guest rooms -> TYPE: 7",
"[textbox] Event space -> TYPE: 50",
"[button] Find -> CLICK",
"[generic] Brand -> CLICK",
"[generic] \ue914 The Ritz-Carlton (4) -> CLICK",
"[button] APPLY -> CLICK"
]
},
{
"website": "store.steampowered",
"id": "4c578076-b877-4097-bf67-e231e349d56f",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Show me the list of most popular upcoming game releases.",
"action_reprs": [
"[link] New & Noteworthy -> CLICK",
"[link] Popular Upcoming -> CLICK",
"[link] Popular Upcoming releases -> CLICK"
]
},
{
"website": "store.steampowered",
"id": "64051efe-53dc-4e79-9980-c3d75d34c4aa",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Open my item inventory.",
"action_reprs": [
"[link] BUCKEYE.FOOBAR -> HOVER",
"[link] INVENTORY -> CLICK"
]
},
{
"website": "store.steampowered",
"id": "718ccfb6-687e-4260-ad6e-9fa3942abec5",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Add the ghost frame to your avatar using steam points.",
"action_reprs": [
"[link] STORE -> HOVER",
"[link] POINTS SHOP -> CLICK",
"[link] Avatar -> CLICK",
"[svg] -> CLICK",
"[div] Ghost -> CLICK"
]
},
{
"website": "cargurus",
"id": "0dd6fbb7-4236-47f7-a69c-30f0836b76c3",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "See the price trends of used Tesla cars from August 1, 2022, to January 31, 2023, and compare the trend with the Cargurus index.",
"action_reprs": [
"[menuitem] Research -> HOVER",
"[menuitem] Price Trends -> CLICK",
"[span] -> CLICK",
"[generic] Previous Month -> CLICK",
"[generic] Previous Month -> CLICK",
"[gridcell] 1 -> CLICK",
"[span] -> CLICK",
"[generic] Previous Month -> CLICK",
"[generic] Previous Month -> CLICK",
"[generic] Previous Month -> CLICK",
"[gridcell] 31 -> CLICK",
"[button] Update Chart -> CLICK",
"[checkbox] Chevrolet \ue066 -> CLICK",
"[checkbox] Ford \ue066 -> CLICK",
"[checkbox] Jeep \ue066 -> CLICK",
"[checkbox] Toyota \ue066 -> CLICK",
"[checkbox] Tesla \ue066 -> CLICK"
]
},
{
"website": "rei",
"id": "54e0d420-ec89-456a-b179-67c6b4b4babc",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Order one TAHE inflatable stand up paddle board using my default account/shipping info.",
"action_reprs": [
"[button] Water -> HOVER",
"[link] Paddle Boards -> CLICK",
"[img] TAHE Beach SUP-Yak Tandem Inflatable Stand Up Padd... -> CLICK",
"[button] Add to cart\u2014$799.95 -> CLICK",
"[link] Cart & Checkout -> CLICK",
"[link] Proceed to checkout -> CLICK",
"[button] Continue without membership -> CLICK",
"[button] Continue -> CLICK",
"[button] Continue with this address -> CLICK",
"[button] Continue -> CLICK"
]
},
{
"website": "united",
"id": "3a231c03-d038-4b61-b5a2-685b77d9920e",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "View the bag charges for the passenger James Son for the flight with the confirmation number 10000002",
"action_reprs": [
"[tab] TRAVEL INFO -> CLICK",
"[link] Baggage info -> CLICK",
"[link] Baggage fee calculator -> CLICK",
"[tab] My flights -> CLICK",
"[textbox] Confirmation number (required) -> TYPE: 10000002",
"[textbox] Last name (required) -> TYPE: Son",
"[button] View my bag charges -> CLICK"
]
},
{
"website": "yelp",
"id": "63e3020c-bf52-4950-9e26-50f98a59b5e3",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Find the fast responding highest-rated electrician, who is currently open for replacement of some light fixtures in Westminster, and request a quote.",
"action_reprs": [
"[link] Home Services -> HOVER",
"[span] Electricians -> CLICK",
"[textbox] Near -> TYPE: WESTMINSTER",
"[span] Westminster -> CLICK",
"[button] Recommended -> CLICK",
"[span] Highest Rated -> CLICK",
"[button] Fast-responding -> CLICK",
"[button] Open Now -> CLICK",
"[button] Request a Quote -> CLICK",
"[radio] Installation or replacement -> CLICK",
"[radio] Light fixture -> CLICK",
"[button] Request pricing -> CLICK"
]
},
{
"website": "yelp",
"id": "759d1c94-3314-481f-8763-5918b00567c4",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Search for Mexican restaurants in Concord, CA and start an order at La Pinata Mexican Restaurant.",
"action_reprs": [
"[textbox] Near -> CLICK",
"[textbox] Near -> TYPE: Concord",
"[span] Concord -> CLICK",
"[textbox] Find -> CLICK",
"[textbox] Find -> TYPE: mexican",
"[span] Mexican -> CLICK",
"[button] Start Order -> CLICK"
]
},
{
"website": "yelp",
"id": "7ce76343-dafe-4cf6-9bfd-918834d0c641",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Find the highest rated fast responding phone repair shop for data recovery in Houston.",
"action_reprs": [
"[link] More -> HOVER",
"[span] Phone Repair -> CLICK",
"[textbox] Near -> TYPE: houston",
"[span] Houston -> CLICK",
"[button] Fast-responding -> CLICK",
"[radio] Data recovery -> CLICK",
"[button] Recommended -> CLICK",
"[span] Highest Rated -> CLICK"
]
},
{
"website": "aa",
"id": "4b2bb9e4-8e28-490b-895f-80da5e7e2815",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Get email alerts for a flight from BHZ to EWN leaving on april 30 on the email lin.lon@gmail.com",
"action_reprs": [
"[link] Flight status -> CLICK",
"[link] Create flight status notification -> CLICK",
"[textbox] From , required. -> TYPE: bhz",
"[a] BHZ - Belo Horizonte, Brazil -> CLICK",
"[textbox] To , required. -> TYPE: ewn",
"[a] EWN - Coastal Carolina Regional, NC -> CLICK",
"[button] \udbf8\udc3a View Calendar: To navigate the calendar, use the... -> CLICK",
"[link] 30 -> CLICK",
"[button] Search -> CLICK",
"[button] Get alerts for this flight for flight 906 American... -> CLICK",
"[textbox] Email -> TYPE: lin.lon@gmail.com",
"[textbox] Confirm email -> TYPE: lin.lon@gmail.com",
"[button] Save -> CLICK"
]
},
{
"website": "aa",
"id": "63529dc2-7b13-493e-9a0c-b1ce50256a16",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Search for the flight status for the flight 12345678 leaving on april 7",
"action_reprs": [
"[link] Flight status -> CLICK",
"[span] Flight number -> CLICK",
"[spinbutton] Flight number , required. -> TYPE: 12345678",
"[combobox] Date -> SELECT: Friday, April 7",
"[button] Search -> CLICK"
]
},
{
"website": "aa",
"id": "6c28458c-ba2a-41a5-b5c2-948f2954c25b",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find the lowest travel time flight for 1 traveler from JFK, NYC to Heathrow, London on April 19, then from Heathrow, London to CDG, Paris on April 21 and then from CDG, Paris to JFK, NYC on April 23",
"action_reprs": [
"[button] PLAN TRAVEL -> CLICK",
"[link] Flights -> CLICK",
"[link] Search flights multiple cities -> CLICK",
"[textbox] From , required. -> CLICK",
"[textbox] From , required. -> TYPE: JFK",
"[a] JFK - New York John F Kennedy Intl, NY -> CLICK",
"[textbox] To , required. -> CLICK",
"[textbox] To , required. -> TYPE: Heathrow",
"[a] LHR - London Heathrow, United Kingdom -> CLICK",
"[textbox] Depart , required. -> TYPE: 04/19/2023",
"[textbox] From , required. -> CLICK",
"[textbox] From , required. -> TYPE: Heathrow",
"[a] LHR - London Heathrow, United Kingdom -> CLICK",
"[textbox] To , required. -> CLICK",
"[textbox] To , required. -> TYPE: CDG",
"[a] CDG - Paris Charles de Gaulle, France -> CLICK",
"[textbox] Depart , required. -> TYPE: 04/21/2023",
"[button] Add another flight -> CLICK",
"[textbox] From , required. -> CLICK",
"[textbox] From , required. -> TYPE: CDG",
"[a] CDG - Paris Charles de Gaulle, France -> CLICK",
"[textbox] To , required. -> CLICK",
"[textbox] To , required. -> TYPE: JFK",
"[a] JFK - New York John F Kennedy Intl, NY -> CLICK",
"[textbox] Depart , required. -> TYPE: 04/23/2023",
"[button] Search -> CLICK",
"[combobox] Sort by: -> SELECT: Total travel time"
]
},
{
"website": "expedia",
"id": "3c098275-ff82-48b1-bd00-6313b4caf215",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Search for car rentals in San Francisco for a weekend trip and filter the results by the rental company Avis and car type Economy.",
"action_reprs": [
"[tab] Cars -> CLICK",
"[textbox] Pick-up -> TYPE: San Francisco",
"[button] San Francisco California, United States -> CLICK",
"[button] Pick-up date April 2, 2023 -> CLICK",
"[button] Apr 8, 2023 -> CLICK",
"[button] Done : (Save changes and close the date picker.) -> CLICK",
"[button] Search -> CLICK",
"[input] -> CLICK",
"[input] -> CLICK"
]
},
{
"website": "expedia",
"id": "5307bed6-1664-4cf7-9e60-0f563f9fa4fe",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Find a hotel room for one traveler on April 3-6 that is closest to National University of Singapore and costs less than $500",
"action_reprs": [
"[button] Going to -> CLICK",
"[textbox] Going to -> TYPE: national university of singapore",
"[button] National University of Singapore Singapore, Singap... -> CLICK",
"[button] Check-in April 5, 2023 -> CLICK",
"[button] Apr 3, 2023 -> CLICK",
"[button] Apr 6, 2023 -> CLICK",
"[button] Done : (Save changes and close the date picker.) -> CLICK",
"[button] 1 room, 2 travelers -> CLICK",
"[img] Decrease adults in room 1 -> CLICK",
"[button] Search -> CLICK",
"[checkbox] Hotel -> CLICK",
"[slider] price -> CLICK",
"[combobox] Sort by -> SELECT: Distance from landmark"
]
},
{
"website": "target",
"id": "cc27fdda-c68f-4d43-bbcb-6c7954bf00ec",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Find Target Stores located near Cincinnati, Ohio and filter by those that have a Starbucks.",
"action_reprs": [
"[link] Find Stores -> CLICK",
"[button] enter zip or city, state -> CLICK",
"[textbox] City -> CLICK",
"[textbox] City -> TYPE: Cincinnati",
"[combobox] State -> SELECT: OH",
"[button] find store -> CLICK",
"[button] filter by services -> CLICK",
"[div] -> CLICK",
"[button] done filtering -> CLICK"
]
},
{
"website": "united",
"id": "bafd6a44-5938-431f-8e2e-17d680d5c48b",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Show me the page with information about Wi-Fi subscriptions.",
"action_reprs": [
"[tab] TRAVEL INFO -> CLICK",
"[link] Pre-paid Wi-Fi -> CLICK",
"[p] Wi-Fi subscriptions -> CLICK"
]
},
{
"website": "uniqlo",
"id": "e8637690-bb8c-4596-a608-5b40a29d77c9",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Locate a large store in Washington that has kids' and maternity products, also check if they have a parking lot, and see the directions of the nearest store.",
"action_reprs": [
"[link] Store Locator -> CLICK",
"[input] -> CLICK",
"[option] WA -> CLICK",
"[button] Products -> CLICK",
"[label] Kids -> CLICK",
"[label] Maternity -> CLICK",
"[button] Store type -> CLICK",
"[label] Large store -> CLICK",
"[button] UNIQLO Bellevue Collection We are located on the 2... -> CLICK"
]
},
{
"website": "nyc",
"id": "2ef75333-ca40-454f-a65c-88b6b60e2497",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "book a tour to the statue of liberty for 3 adult on march 27th",
"action_reprs": [
"[link] tours. -> CLICK",
"[li] Boat Tours -> CLICK",
"[div] Show Info -> CLICK",
"[link] View Tickets Now -> CLICK",
"[button] Check Availability -> CLICK",
"[div] 27 -> CLICK",
"[button] increase number -> CLICK",
"[button] Apply -> CLICK",
"[button] 10:30 AM -> CLICK",
"[button] Book Now -> CLICK"
]
},
{
"website": "nyc",
"id": "4fe76361-f0e3-458f-a3d5-453da3c7cecc",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "List of Broadway events sorted by date.",
"action_reprs": [
"[link] broadway. -> CLICK",
"[li] Shows By Date -> CLICK"
]
},
{
"website": "nyc",
"id": "7ad37a91-c4c2-42d6-9b87-1f3e6a81647e",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "check reservation availability for an Indian restaurant with price below $30 in East village",
"action_reprs": [
"[link] restaurants. -> CLICK",
"[li] Cuisine -> CLICK",
"[link] Indian/Pakistani -> CLICK",
"[link] East Village (9) -> CLICK",
"[link] $16 To $30 (4) -> CLICK",
"[link] Reservations -> CLICK"
]
},
{
"website": "rei",
"id": "8865ca64-0df2-4e3f-905d-a9e07e1eeb68",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Show bike service charges for store at Lafayette St, 10013.",
"action_reprs": [
"[button] Cycle -> CLICK",
"[link] Shop Services -> CLICK",
"[link] Find a bike shop near you -> CLICK",
"[textbox] Enter ZIP or City, State -> TYPE: 10013",
"[button] Search nearest REI stores -> CLICK",
"[link] See services menu -> CLICK"
]
},
{
"website": "viator",
"id": "2e133e56-ac17-41dc-987a-257078d770c3",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find on the water activities in Dubai from 5pm to 12am with a maximum duration of four hours",
"action_reprs": [
"[textbox] Where to? -> TYPE: Dubai",
"[button] Dubai United Arab Emirates -> CLICK",
"[path] -> CLICK",
"[button] -> CLICK",
"[div] On the Water -> CLICK",
"[label] Up to 1 hour -> CLICK",
"[label] 1 to 4 hours -> CLICK",
"[div] 5pm\u201412am -> CLICK"
]
},
{
"website": "viator",
"id": "39937001-8af2-4727-bb2a-6997981cf50d",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Show me a list of tours available at the Coliseum with free cancellation.",
"action_reprs": [
"[span] Top activities -> HOVER",
"[span] Colosseum -> CLICK",
"[link] Tours & Tickets -> CLICK",
"[label] Free Cancellation -> CLICK"
]
},
{
"website": "cvs",
"id": "53b4ca73-c05b-4609-98c8-a0a62072bdb5",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Add cheapest vitamin C and D to cart.",
"action_reprs": [
"[button] Shop -> CLICK",
"[button] load Vitamins Menu -> CLICK",
"[button] load Vitamins A-Z Menu -> CLICK",
"[link] Vitamin C -> CLICK",
"[div] Relevance -> CLICK",
"[div] Price Low to High -> CLICK",
"[img] CVS Health Vitamin C Tablets 250mg, 100CT -> CLICK",
"[button] Add CVS Health Vitamin C Tablets 250mg, 100CT to B... -> CLICK",
"[img] -> CLICK",
"[link] Vitamins A-Z -> CLICK",
"[img] Vitamin D -> CLICK",
"[div] Relevance -> CLICK",
"[div] Price Low to High -> CLICK",
"[button] Add CVS Health Vitamin D Softgels 400IU, 100CT to ... -> CLICK"
]
},
{
"website": "enterprise",
"id": "9572e7bd-0365-4339-899d-1d1dc8504543",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Reserve a lowest priced car for pickup from Birmingham Airport, Alabama, at 11 am on March 22, 2023, and the return location is Montogomery Airport, Alabama, at 5 pm on March 25, 2023.",
"action_reprs": [
"[searchbox] Pick-up & Return Location (ZIP, City or Airport) (... -> TYPE: BIRMINGHAM",
"[span] Birmingham -> CLICK",
"[checkbox] Return to a different location -> CLICK",
"[searchbox] Return Location (ZIP, City or Airport) (required) -> TYPE: MONTGOM",
"[span] Montgom -> CLICK",
"[button] Selected Pick-Up Date 03/21/2023 -> CLICK",
"[button] Selected Return Date 03/22/2023 -> CLICK",
"[combobox] Pick-Up Time Selector -> SELECT: 11:00 AM",
"[span] 22 -> CLICK",
"[button] 03/25/2023 -> CLICK",
"[combobox] Return Time Selector -> SELECT: 5:00 PM",
"[button] Browse Vehicles -> CLICK",
"[combobox] SORT BY -> SELECT: Price: Low to High",
"[button] Select Mitsubishi Mirage Vehicle -> CLICK",
"[button] Continue to Review -> CLICK"
]
},
{
"website": "target",
"id": "2c19d467-4e44-4c0d-b050-a13823ca545d",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Find hard side Carry-on Luggage used for business in black color.",
"action_reprs": [
"[link] Categories -> CLICK",
"[span] Luggage -> CLICK",
"[span] Carry-on Luggage -> CLICK",
"[img] -> CLICK",
"[svg] -> CLICK",
"[button] Color -> CLICK",
"[div] -> CLICK",
"[svg] -> CLICK",
"[button] Used for -> CLICK",
"[div] -> CLICK",
"[svg] -> CLICK"
]
},
{
"website": "target",
"id": "2f660153-d470-4744-8b75-f8dc64c7f94e",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Explore Games & Puzzles in the Toys category that are suitable for ages 14+",
"action_reprs": [
"[link] Categories -> CLICK",
"[span] Toys -> CLICK",
"[span] Games & Puzzles -> CLICK",
"[button] Explore All -> CLICK",
"[button] Age -> CLICK",
"[div] -> CLICK",
"[button] close -> CLICK"
]
},
{
"website": "target",
"id": "33064851-00d9-46c8-b0b7-6b5048005c51",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Find a registry in the name of Sheldon Cooper in Arizona and sort by latest to soonest.",
"action_reprs": [
"[link] Registry -> CLICK",
"[button] Find a registry -> CLICK",
"[textbox] First name -> CLICK",
"[textbox] First name -> TYPE: SHELDON",
"[textbox] Last name -> CLICK",
"[textbox] Last name -> TYPE: COOPER",
"[button] Search -> CLICK",
"[button] Filter -> CLICK",
"[combobox] Location -> SELECT: Arizona",
"[combobox] Sort by -> SELECT: Date - latest to soonest"
]
},
{
"website": "sixflags",
"id": "b4362dec-6803-415a-a112-819f694b84d9",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Purchase a one meal season dining pass for the Six flags great america",
"action_reprs": [
"[button] Browse the Parks Below -> CLICK",
"[span] Six Flags Great America -> CLICK",
"[button] Go! -> CLICK",
"[link] Tickets & Passes \uf078 -> CLICK",
"[link] One Day Add-Ons -> CLICK",
"[link] Buy Now -> CLICK",
"[menuitem] Meal Deals -> CLICK",
"[menuitem] All Season Dining -> CLICK",
"[img] One Meal Season Dining Pass -> CLICK",
"[button] Add to Cart -> CLICK"
]
},
{
"website": "newegg",
"id": "10593972-6b1d-4b07-ba61-cb56ca0f06e3",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "Find a Lenovo laptop under $800 and create a price alert for $400.",
"action_reprs": [
"[searchbox] Search Site -> TYPE: lenovo laptop",
"[button] \uf002 -> CLICK",
"[div] Newest Lenovo Ideapad 3i Laptop, 14\" FHD Display, ... -> CLICK",
"[div] Price Alert -> CLICK",
"[textbox] price from -> TYPE: 400",
"[button] SUBMIT -> CLICK"
]
},
{
"website": "newegg",
"id": "1282a011-194c-40c4-8f76-875e502cdd53",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "Browse laptops with at least 16gb of ram and under $700.",
"action_reprs": [
"[searchbox] Search Site -> TYPE: laptop",
"[button] \uf002 -> CLICK",
"[textbox] price to -> TYPE: 700",
"[button] APPLY -> CLICK",
"[dt] Memory -> CLICK",
"[span] Show -> CLICK",
"[span] 16GB -> CLICK",
"[button] APPLY -> CLICK"
]
},
{
"website": "ebay",
"id": "1ced6d51-577b-4e85-b96e-b823dbbcbf29",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Find a newly listed pre-owned man Nike shoe in size 9 with free local pickup under 75 dollars.",
"action_reprs": [
"[link] Fashion -> HOVER",
"[link] Men's Shoes -> CLICK",
"[link] Nike -> CLICK",
"[button] US Shoe Size -> CLICK",
"[link] 9 -> CLICK",
"[button] Condition -> CLICK",
"[link] Pre-owned -> CLICK",
"[button] Sort: Best Match -> CLICK",
"[link] Time: newly listed -> CLICK",
"[button] Price -> CLICK",
"[link] Under $75.00 -> CLICK",
"[button] Delivery Options -> CLICK",
"[link] Free Local Pickup -> CLICK"
]
},
{
"website": "nfl",
"id": "9ebd069a-7703-47b5-9c75-53958637e7c0",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Watch the halftime show from the most recent Super Bowl",
"action_reprs": [
"[use] -> CLICK",
"[link] Super Bowl -> CLICK",
"[link] WATCH -> CLICK"
]
},
{
"website": "nfl",
"id": "a1d1f6c0-1ae9-47f0-b054-8f3f9935b7da",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Find the schedule for the San Francisco 49ers.",
"action_reprs": [
"[link] Schedule -> CLICK",
"[link] Team Schedules -> CLICK",
"[link] Schedule - Opens new window -> CLICK"
]
},
{
"website": "nfl",
"id": "c577375b-ecca-42f8-920c-b06809eef2b4",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Find the retired players named James Smith",
"action_reprs": [
"[link] Players -> CLICK",
"[link] RETIRED -> CLICK",
"[textbox] Search by player name -> TYPE: James Smith",
"[button] Search Players -> CLICK"
]
},
{
"website": "nfl",
"id": "cb07d410-75ff-483a-920c-3ce2a295524f",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Find the kicker with the most made field goals in the 2022-2023 NFL season.",
"action_reprs": [
"[link] Stats -> CLICK",
"[link] Field Goals -> CLICK",
"[link] Justin Tucker profile page -> CLICK"
]
},
{
"website": "nfl",
"id": "f75e33a6-d7d6-4eea-9ac8-f47be0224114",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Find the score of the 2020 Super Bowl.",
"action_reprs": [
"[link] Scores -> CLICK",
"[select] 2023 -> SELECT: 2020"
]
},
{
"website": "nfl",
"id": "fc81025d-f5a3-4b68-9551-e84175b87a63",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Find the video highlights of the most recent Super Bowl.",
"action_reprs": [
"[svg] -> CLICK",
"[link] Super Bowl -> CLICK",
"[button] Next -> CLICK",
"[heading] Mahomes maneuvers pocket on magical 26-yard scramb... -> CLICK"
]
},
{
"website": "ebay",
"id": "4a0bd619-4aa9-48d8-8322-89a86aef93db",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Find a newly listed used antique Oak chair in the French style made before year 1800.",
"action_reprs": [
"[link] Collectibles -> CLICK",
"[button] Antiques -> CLICK",
"[link] Furniture -> CLICK",
"[link] Chairs -> CLICK",
"[button] Sort: Best Match -> CLICK",
"[link] Time: newly listed -> CLICK",
"[button] Condition -> CLICK",
"[link] Used -> CLICK",
"[button] Style -> CLICK",
"[link] French -> CLICK",
"[button] Material -> CLICK",
"[link] Oak -> CLICK",
"[button] Time Period Manufactured -> CLICK",
"[link] Pre-1800 -> CLICK"
]
},
{
"website": "ebay",
"id": "4f069a59-c53b-4efe-bcfb-fc9fd864ea2e",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Search for rare books and sort the results by auction end time.",
"action_reprs": [
"[combobox] Search for anything -> CLICK",
"[combobox] Search for anything -> TYPE: rare books",
"[button] Search -> CLICK",
"[link] Auction -> CLICK",
"[button] Sort selector. Best Match selected. -> CLICK",
"[link] Time: ending soonest -> CLICK"
]
},
{
"website": "ebay",
"id": "6da08512-9375-4b47-8cd1-addec58f385c",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Find musical instruments and filter the results to show only those that are available for free local pickup.",
"action_reprs": [
"[combobox] Search for anything -> CLICK",
"[combobox] Search for anything -> TYPE: musical instruments",
"[option] musical instruments -> CLICK",
"[button] Local -> CLICK",
"[menuitemcheckbox] Free Local Pickup -> CLICK"
]
},
{
"website": "ebay",
"id": "7bdebbfa-2512-48e2-93b1-d92e2c87c6e1",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Find vintage clothing and sort the results by price from high to low.",
"action_reprs": [
"[combobox] Search for anything -> CLICK",
"[combobox] Search for anything -> TYPE: vintage clothing",
"[option] vintage clothing -> CLICK",
"[button] Sort selector. Best Match selected. -> CLICK",
"[link] Price + Shipping: highest first -> CLICK"
]
},
{
"website": "cargurus",
"id": "69661946-6c3e-4e26-95ed-1f7641a31f22",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Browse listings for a used Toyota Corolla near 10019 and sort by cheapest.",
"action_reprs": [
"[LabelText] Buy Used -> CLICK",
"[combobox] Select Make -> SELECT: Toyota",
"[combobox] Select Model -> SELECT: Corolla",
"[textbox] Zip -> TYPE: 10019",
"[button] Search -> CLICK",
"[combobox] Select Sort Order -> SELECT: Lowest price first"
]
},
{
"website": "cargurus",
"id": "82c5913d-8392-44a2-8873-6627a281fa23",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Calculate monthly payment for car value of $50,000 and downpayment of $10,000 with interest rate of 4% for 60 months.",
"action_reprs": [
"[menuitem] Finance -> HOVER",
"[menuitem] Loan Calculator -> CLICK",
"[input] -> TYPE: 50000",
"[input] -> TYPE: 10000",
"[input] -> CLICK",
"[input] -> TYPE: 4",
"[span] 60 mo -> CLICK"
]
},
{
"website": "viator",
"id": "64779409-c396-4779-a574-b219c3b22282",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find the longest skiing activity in August 10",
"action_reprs": [
"[textbox] Where to? -> TYPE: skiing",
"[button] When -> CLICK",
"[button] Next -> CLICK",
"[path] -> CLICK",
"[button] Next -> CLICK",
"[button] Next -> CLICK",
"[button] Next -> CLICK",
"[gridcell] Thu Aug 10 2023 -> CLICK",
"[button] Apply -> CLICK",
"[circle] -> CLICK",
"[svg] -> CLICK",
"[span] Duration (Long to Short) -> CLICK"
]
},
{
"website": "viator",
"id": "7b7079f0-8891-426a-8e53-0818a02a0159",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Show me things to do nearby in Mar 30, 202\n3",
"action_reprs": [
"[textbox] Where to? -> CLICK",
"[button] Nearby -> CLICK",
"[gridcell] Thu Mar 30 2023 -> CLICK",
"[button] Apply -> CLICK",
"[circle] -> CLICK"
]
},
{
"website": "budget",
"id": "27a8bf82-2e7e-48c3-8fb1-66909c13d585",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Find a Buick for sale within 250 miles from 26807.",
"action_reprs": [
"[button] Cars & Services -> CLICK",
"[link] Car Sales -> CLICK",
"[combobox] All Makes -> CLICK",
"[textbox] Zip Code: 43085 -> TYPE: 26807",
"[combobox] 25 miles -> CLICK",
"[generic] 250 miles -> CLICK",
"[button] View 95 Vehicles -> CLICK",
"[i] -> CLICK",
"[checkbox] Buick\ufeff1 -> CLICK",
"[img] -> CLICK"
]
},
{
"website": "budget",
"id": "31c12c59-d9b8-4d9a-8456-9f1107d0e5f8",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Find the reservation made by James Smith in the United States with Confirmation Number 123456",
"action_reprs": [
"[button] Reservations -> CLICK",
"[link] View / Modify / Cancel -> CLICK",
"[combobox] Select Residency -> SELECT: UNITED STATES",
"[input] -> TYPE: smith",
"[input] -> TYPE: 123456",
"[button] Find Reservation -> CLICK"
]
},
{
"website": "budget",
"id": "942e315d-b494-469c-93df-cd69c88ea2d2",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Find information regarding Fastbreak program.",
"action_reprs": [
"[button] Fastbreak -> CLICK",
"[link] Fastbreak Program -> CLICK",
"[link] Join Now -> CLICK",
"[button] Save -> HOVER"
]
},
{
"website": "marriott",
"id": "56d210ec-22eb-4b3f-ba76-ee531403701a",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Use the \"Meetings & Events\" section of the website to browse locations for a business meeting for one room and 20 guests in Boston from May 30th to June 1st.",
"action_reprs": [
"[button] Meetings & Events -> CLICK",
"[link] Book An Event Book a Meeting or Event -> CLICK",
"[textbox] Destination -> TYPE: Boston",
"[menuitem] Boston, MA, USA -> CLICK",
"[textbox] Start Date -> CLICK",
"[button] \ue023 -> CLICK",
"[gridcell] Tue, May 30, 2023 -> CLICK",
"[gridcell] Thu, Jun 1, 2023 -> CLICK",
"[label] Purpose of your event -> CLICK",
"[li] Business -> CLICK",
"[textbox] Guest rooms -> TYPE: 1",
"[textbox] Event space -> TYPE: 20",
"[button] Find -> CLICK"
]
},
{
"website": "carmax",
"id": "8bfeeb54-beb9-4271-9436-fbd1a705efcd",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Find the cheapest 2017 Honda Civic within 100 miles of 07470 which has a sun roof and black exterior color while excluding out of market vehicles",
"action_reprs": [
"[link] SEARCH CARS -> CLICK",
"[button] Distance & Shipping -> CLICK",
"[button] Change Location -> CLICK",
"[textbox] Enter ZIP or State -> CLICK",
"[textbox] Enter ZIP or State -> TYPE: 07470",
"[button] set store -> CLICK",
"[button] Distance & Shipping -> CLICK",
"[button] Nationwide -> CLICK",
"[menuitem] 100 miles -> CLICK",
"[input] -> CLICK",
"[button] Back to all categories -> CLICK",
"[button] Make -> CLICK",
"[listitem] Honda (116) Honda (116) -> CLICK",
"[button] Back to all categories -> CLICK",
"[button] Model -> CLICK",
"[listitem] Civic (35) Civic (35) -> CLICK",
"[button] Back to all categories -> CLICK",
"[button] Year -> CLICK",
"[button] 2010 -> CLICK",
"[menuitem] 2017 -> CLICK",
"[button] 2023 -> CLICK",
"[menuitem] 2017 -> CLICK",
"[button] Back to all categories -> CLICK",
"[button] Features -> CLICK",
"[listitem] Sunroof(s) (2) Sunroof(s) (2) -> CLICK",
"[button] Back to all categories -> CLICK",
"[button] Exterior Color -> CLICK",
"[listitem] Black (1) Black (1) -> CLICK",
"[button] Back to all categories -> CLICK",
"[button] Sort by -> CLICK",
"[label] Lowest price -> CLICK"
]
},
{
"website": "soundcloud",
"id": "4c623130-32db-4cc8-928a-68b0bc816efc",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Find artist Mark Knight from London and follow him and add his most liked track to next up.",
"action_reprs": [
"[searchbox] Search -> TYPE: Mark Knight",
"[button] Search -> CLICK",
"[link] Mark Knight -> CLICK",
"[button] Follow -> CLICK",
"[link] Popular tracks -> CLICK",
"[button] More -> CLICK",
"[span] Add to Next up -> CLICK"
]
},
{
"website": "soundcloud",
"id": "57f72023-3633-4c97-93f6-af12fe2edf4f",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Find a south african history podcast with length between 10 to 30 minutes and filter it by audiobook tag.",
"action_reprs": [
"[searchbox] Search -> TYPE: SOUTH AFRICAN HISTORY PODCAST",
"[button] Search -> CLICK",
"[link] Tracks -> CLICK",
"[link] Any length -> CLICK",
"[link] 10-30 min -> CLICK",
"[link] # Audiobooks -> CLICK"
]
},
{
"website": "agoda",
"id": "4596152e-6589-4bf2-9c9f-dd3ed9e8c0dc",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Find out details about cancellation fees.",
"action_reprs": [
"[link] FAQs -> CLICK",
"[link] \uf2b1Cancellation -> CLICK",
"[button] Will I be charged if I cancel my booking? -> CLICK"
]
},
{
"website": "agoda",
"id": "49c60777-2500-4cea-8200-a95d3be2c9a1",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Find rental for an economy car in Houston from Mar 10 to Mar 13.",
"action_reprs": [
"[button] Ellipsis Icon -> CLICK",
"[link] Car rentals -> CLICK",
"[textbox] Pick up -> TYPE: Houston",
"[a] Houston, US -> CLICK",
"[button] Search -> CLICK",
"[button] Economy cars 5\u00a0Seats 1 Large bag 1 Small bag From ... -> CLICK",
"[p] Economy -> CLICK",
"[link] SELECT CAR FIAT 500 \u00a0OR SIMILAR -> CLICK"
]
},
{
"website": "cargurus",
"id": "e91126e0-023d-4f96-9378-74efb5d6ecc3",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Check reviews and research information about Audi A6 2020.",
"action_reprs": [
"[menuitem] Research -> CLICK",
"[combobox] Select Make -> SELECT: Audi",
"[combobox] Select Model -> SELECT: A6",
"[combobox] Select Year -> SELECT: 2020",
"[button] Search -> CLICK",
"[tab] User reviews -> CLICK"
]
},
{
"website": "cargurus",
"id": "edb8e817-e9d7-45eb-9706-01967e3a0fe8",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Get offer to sell car with AZ XA1234 number plate from Arizona state.",
"action_reprs": [
"[LabelText] Sell My Car -> CLICK",
"[textbox] Enter license plate -> TYPE: XA1234",
"[combobox] state -> SELECT: AZ",
"[button] Get your offer -> HOVER"
]
},
{
"website": "cargurus",
"id": "eeeee9d8-5387-46bc-a741-5bcb66b46f31",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Look for a job opening in sales in San Fransisco, and if found, apply for the job.",
"action_reprs": [
"[link] Our Team -> CLICK",
"[menuitem] olink -> CLICK",
"[link] See Open Roles -> CLICK",
"[textbox] Select Department -> CLICK",
"[option] Sales & Ad Ops -> CLICK",
"[textbox] Locations -> CLICK",
"[option] US, CA, San Francisco -> CLICK",
"[link] Manager, Field Sales - West -> CLICK",
"[link] Apply Now -> CLICK"
]
},
{
"website": "cargurus",
"id": "fcb50c4e-a89e-4f18-b7c0-423295e7c298",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Search for a certified pre-owned front-wheel drive Jeep, Compass model car with single owner and the lowest mileage within 500 miles of zip 59316.",
"action_reprs": [
"[menuitem] Buy -> HOVER",
"[menuitem] Certified Cars -> CLICK",
"[combobox] makes -> SELECT: Jeep",
"[combobox] models -> SELECT: Compass",
"[textbox] Zip* -> TYPE: 59316",
"[combobox] distance -> SELECT: 500 mi",
"[button] Search Certified Pre-Owned -> CLICK",
"[p] Four-Wheel Drive -> CLICK",
"[p] Single Owner -> CLICK",
"[combobox] Select Sort Order -> SELECT: Lowest mileage first",
"[div] Request Info -> CLICK",
"[span] Send -> CLICK",
"[span] Send -> CLICK"
]
},
{
"website": "ryanair",
"id": "c5070129-37b1-4f87-930f-c45049a70e97",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Use the FareFinder to find flights for $150 or less from Dublin to anywhere.",
"action_reprs": [
"[button] Plan -> CLICK",
"[link] Fare Finder -> CLICK",
"[textbox] From: -> CLICK",
"[div] Dublin -> CLICK",
"[textbox] To: -> CLICK",
"[div] Anywhere -> CLICK",
"[svg] -> CLICK",
"[div] $ 150 -> CLICK",
"[button] Let's go -> CLICK"
]
},
{
"website": "parking",
"id": "50bd08bd-989f-44ba-8a99-71e75ba602f1",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Show cheapest monthly price for parking near Shubert Theatre.",
"action_reprs": [
"[span] Enter an Address or Venue to find parking -> TYPE: Shubert Theatre",
"[option] Shubert Theatre\u00a0\u00a0225 West 44th Street, New York De... -> CLICK",
"[link] MONTHLY -> CLICK",
"[span] Distance -> CLICK",
"[link] Price -> CLICK",
"[link] View Details BILTMORE GARAGE -> CLICK"
]
},
{
"website": "parking",
"id": "7f640279-bd9d-45ae-b3fc-43338977e2c1",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find the list of Museums in New York City.",
"action_reprs": [
"[link] CITIES -> CLICK",
"[link] NEW YORK CITY -> CLICK",
"[link] Museums -> CLICK"
]
},
{
"website": "parking",
"id": "8b743c63-2a99-4c29-93ef-af920dab9535",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Browse monthly parking rates near the Museum of Modern Art.",
"action_reprs": [
"[combobox] \uf002\u00a0 Enter an Address or Venue to find parking -> TYPE: MOMA",
"[option] Museum of Modern Art (MoMA) \u00a0\u00a011 West 53rd St, New... -> CLICK",
"[link] MONTHLY -> CLICK",
"[button] See options -> CLICK",
"[button] YES, PROCEED -> CLICK"
]
},
{
"website": "us.megabus",
"id": "3358dffd-3673-435b-bfcb-cb242a2c622c",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Browse round-trip bus tickets from Houston to Dallas leaving on May 7th and returning a week later.",
"action_reprs": [
"[textbox] From (type text or use the arrow keys) -> TYPE: Houston",
"[span] Houston, TX -> CLICK",
"[textbox] To (type text or use the arrow keys) -> TYPE: Dallas",
"[div] Dallas, TX -> CLICK",
"[input] -> CLICK",
"[button] Next month -> CLICK",
"[gridcell] May 07, 2023 -> CLICK",
"[input] -> CLICK",
"[gridcell] May 14, 2023 -> CLICK",
"[button] Find tickets -> CLICK"
]
},
{
"website": "us.megabus",
"id": "44ad28c9-c0d6-4d41-a49d-afeaa6ecaabe",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Book a one way bus ticket between Albany, NY and Bloomington, NY April 10th and add the second one to cart.",
"action_reprs": [
"[textbox] From (type text or use the arrow keys) -> TYPE: Albany, NY",
"[div] Albany, NY -> CLICK",
"[textbox] To (type text or use the arrow keys) -> TYPE: Bloomington, NY",
"[span] Bloomington, NY -> CLICK",
"[textbox] Pick a date -> CLICK",
"[button] Next month -> CLICK",
"[gridcell] April 10, 2023 -> CLICK",
"[button] Find tickets -> CLICK",
"[button] Add to basket -> CLICK"
]
},
{
"website": "us.megabus",
"id": "4b99412b-6be2-4274-8843-4fc97f0c8247",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Track the bus with service number 10000001",
"action_reprs": [
"[button] Check my bus\ue911 -> CLICK",
"[link] Track my bus -> CLICK",
"[tab] Service Number -> CLICK",
"[combobox] Search by Service Number -> TYPE: 10000001",
"[combobox] Search by Service Number -> ENTER"
]
},
{
"website": "us.megabus",
"id": "54d60a7c-f52d-4d79-b879-34698507e22c",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Book a round-trip from Albany to New York leaving Mar 18 and returning Mar 19 for 3 people",
"action_reprs": [
"[textbox] From (type text or use the arrow keys) -> TYPE: albany",
"[span] Albany, NY -> CLICK",
"[textbox] To (type text or use the arrow keys) -> TYPE: New York",
"[span] New York, NY -> CLICK",
"[input] -> CLICK",
"[gridcell] March 18, 2023 -> CLICK",
"[input] -> CLICK",
"[gridcell] March 19, 2023 -> CLICK",
"[spinbutton] How many travelers? -> TYPE: 3",
"[button] Find tickets -> CLICK"
]
},
{
"website": "us.megabus",
"id": "7eff6c15-bab6-4ce4-abb8-72619f593ea1",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Track my bus with service number SE4.",
"action_reprs": [
"[button] Check my bus\ue911 -> CLICK",
"[link] Track my bus -> CLICK",
"[tab] Service Number -> CLICK",
"[combobox] Search by Service Number -> TYPE: SE4",
"[span] Columbia, SC -> CLICK",
"[button] Find my bus -> CLICK"
]
},
{
"website": "us.megabus",
"id": "ab139e9d-eb99-47f7-8d0b-f93479fadadf",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Track a bus using service number 5456165184.",
"action_reprs": [
"[button] Check my bus\ue911 -> CLICK",
"[link] Track my bus -> CLICK",
"[tab] Service Number -> CLICK",
"[combobox] Search by Service Number -> TYPE: 5456165184"
]
},
{
"website": "us.megabus",
"id": "ba5e0124-b1c0-4116-968c-6b31a4c9c0a7",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find cheapest bus for 2 persons from New York to Washington, DC.",
"action_reprs": [
"[label] One way -> CLICK",
"[textbox] From (type text or use the arrow keys) -> TYPE: New York",
"[span] New York, NY -> CLICK",
"[textbox] To (type text or use the arrow keys) -> TYPE: Washington",
"[span] Washington, DC -> CLICK",
"[span] -> CLICK",
"[button] Find tickets -> CLICK",
"[combobox] Sort: -> SELECT: Price",
"[button] 3:00AM\ue905 7:45AM \uf05a INFORMATION $55.00 4h 45m, 0 tran... -> CLICK"
]
},
{
"website": "espn",
"id": "cfb351f8-804b-4074-9826-0b3525f68727",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "check the 2022 highest goal scorer in the MLS league",
"action_reprs": [
"[button] Soccer -> HOVER",
"[link] Leagues & Cups -> CLICK",
"[link] Stats -> CLICK",
"[select] 2023 -> SELECT: 2022"
]
},
{
"website": "espn",
"id": "d7ab9bf0-99e2-4f32-92c9-c1a10bc68f82",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "check Manchester City Performance Stats of 2022/2023 season in the champions league",
"action_reprs": [
"[link] ESPN Soccer Home Page -> HOVER",
"[link] Champions League -> CLICK",
"[link] Manchester City -> CLICK",
"[link] Stats -> CLICK",
"[select] English FA Community Shield -> SELECT: UEFA Champions League",
"[select] 2022-23 -> SELECT: 2022-23",
"[link] Performance -> CLICK"
]
},
{
"website": "rei",
"id": "d4298ee7-ac1d-4cac-bfa6-62bf7cd67004",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Show camping hammocks with lowest price first.",
"action_reprs": [
"[button] Camp & Hike -> CLICK",
"[button] Camp & Hike -> CLICK",
"[link] Hammocks -> CLICK",
"[link] Camping Hammocks (21) -> CLICK",
"[combobox] Sort By -> SELECT: Price: Low - High"
]
},
{
"website": "ebay",
"id": "bc45669b-6bed-4240-9d9b-6b5e45a7e6f3",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Browse xbox series x consoles that are used and between $200 and $400.",
"action_reprs": [
"[combobox] Search for anything -> TYPE: xbox series x console",
"[button] Search -> CLICK",
"[input] -> CLICK",
"[textbox] Minimum Value in $ -> TYPE: 200",
"[textbox] Maximum Value in $ -> TYPE: 400",
"[button] Submit price range -> CLICK"
]
},
{
"website": "ebay",
"id": "cf8da12a-e1fd-48b5-8c53-b88f301ca1e0",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Search for video game consoles and filter the results to show only those that have Wi-Fi Capability.",
"action_reprs": [
"[link] Electronics -> CLICK",
"[button] Video Games & Consoles -> CLICK",
"[link] Video Game Consoles -> CLICK",
"[button] All Filters -> CLICK",
"[tab] Features -> CLICK",
"[checkbox] Wi-Fi Capability -> CLICK",
"[button] Apply -> CLICK"
]
},
{
"website": "ebay",
"id": "df3b7cd4-526e-453b-9114-c0db1b3ed5ea",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Search for Dining Room Sets under furniture and filter the results to show only items availble under the Buy It Now format.",
"action_reprs": [
"[link] Home & Garden -> CLICK",
"[button] Furniture -> CLICK",
"[link] Dining Sets -> CLICK",
"[button] Buying Format -> CLICK",
"[link] Buy It Now -> CLICK"
]
},
{
"website": "enterprise",
"id": "1df0723c-f732-4ecb-b202-8e1854b7c079",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Browse a list of rental vehicles for Brooklyn, OH, US for 18 year old renter.",
"action_reprs": [
"[searchbox] Pick-up & Return Location (ZIP, City or Airport) (... -> TYPE: Brooklyn",
"[option] Brooklyn, OH, US Select -> CLICK",
"[combobox] Renter Age -> SELECT: 18",
"[button] Browse Vehicles -> CLICK"
]
},
{
"website": "yellowpages",
"id": "95936f53-1e60-4bad-9cd2-65831e309768",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Browse restaurants, open 24 hours, and sorted by rating.",
"action_reprs": [
"[link] Restaurants -> CLICK",
"[link] OPEN 24 Hours -> CLICK",
"[link] Default -> CLICK",
"[a] Rating -> CLICK"
]
},
{
"website": "sixflags",
"id": "5098c679-dacc-4abd-9331-18b898f936dd",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "What are the St louis park policies regarding security?",
"action_reprs": [
"[button] Browse the Parks Below -> CLICK",
"[span] Six Flags St. Louis -> CLICK",
"[button] Go! -> CLICK",
"[link] Plan Your Visit \uf078 -> CLICK",
"[link] Park Policies -> CLICK",
"[link] Security -> CLICK"
]
},
{
"website": "ticketcenter",
"id": "fdcac1e8-1dd0-4846-b2cf-16d916ea9e17",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "search for tickets for los angeles kings this weekend",
"action_reprs": [
"[textbox] Search for artists, teams or venues... -> TYPE: los angeles kings",
"[option] Los Angeles Kings -> CLICK",
"[button] All dates -> CLICK",
"[link] This weekend -> CLICK"
]
},
{
"website": "newegg",
"id": "8eae88ef-9641-43c6-be6d-f8abc96d99fa",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "Find the most expensive Sony controller compatible with PS5 with free shipping and add it to my cart.",
"action_reprs": [
"[link] \ue92d Gaming & VR \uf105 -> HOVER",
"[link] PS5 Accessories -> CLICK",
"[generic] Controller -> CLICK",
"[span] Sony -> CLICK",
"[button] APPLY -> CLICK",
"[span] Free Shipping -> CLICK",
"[button] APPLY -> CLICK",
"[combobox] Featured Items \uf0d7 -> SELECT: Highest Price",
"[button] ADD TO CART \uf0da -> CLICK"
]
},
{
"website": "marriott",
"id": "69065697-a426-4e4c-80f7-82bf592b268c",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Find details on converting points to miles.",
"action_reprs": [
"[link] Redeem Points \ue922 -> CLICK",
"[link] Learn More -> CLICK"
]
},
{
"website": "marriott",
"id": "76514d5c-cc1c-40b0-8c08-427cedb106e4",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Search for queen-size pillow protectors from the Marriot shop, and if found, add two pieces to the cart and checkout.",
"action_reprs": [
"[button] Special Offers -> CLICK",
"[link] Shop Marriott Opens a new window -> CLICK",
"[menuitem] category pillows -> CLICK",
"[span] Pillow Protector -> CLICK",
"[combobox] Select a Size -> SELECT: Queen",
"[spinbutton] Main item quantity -> TYPE: 2",
"[button] ADD TO BAG -> CLICK",
"[link] CHECKOUT -> CLICK"
]
},
{
"website": "yelp",
"id": "49372757-4c58-4cb5-bdb4-eed0c3e83199",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Find an electrician that serves the 94115 zip code and is considered Fast Responding",
"action_reprs": [
"[textbox] Near -> CLICK",
"[textbox] Near -> TYPE: 94115",
"[textbox] Find -> CLICK",
"[textbox] Find -> TYPE: electrician",
"[span] Electrician -> CLICK",
"[button] Fast-responding -> CLICK"
]
},
{
"website": "last.fm",
"id": "d042ee7e-a2eb-448b-9942-b7aacc9115be",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Find the soonest upcoming event near zip code 90028.",
"action_reprs": [
"[link] Events -> CLICK",
"[button] Near you -> CLICK",
"[textbox] Location search -> TYPE: 90028",
"[span] 90028 -> CLICK",
"[button] APPLY -> CLICK"
]
},
{
"website": "last.fm",
"id": "d6a0ab7c-f0d7-4ff7-9d42-55b44b5e7f74",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Search for the artist profile of M S Subbulakshmi and play all from the top tracks.",
"action_reprs": [
"[link] Search -> CLICK",
"[textbox] Search -> TYPE: m s subbulakshmi",
"[button] Search -> CLICK",
"[link] M.S. Subbulakshmi -> CLICK",
"[button] Play all -> CLICK"
]
},
{
"website": "last.fm",
"id": "e72f9c32-4633-4fcf-abd7-b7cc4a9aaba3",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Find similar artists to the Weekend.",
"action_reprs": [
"[link] Search -> CLICK",
"[textbox] Search -> TYPE: the weeknd",
"[button] Search -> CLICK",
"[a] -> CLICK",
"[link] View all artists -> CLICK"
]
},
{
"website": "ebay",
"id": "8f567f79-e197-4d7e-9a49-877daae6dde5",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Find a Blue iPhone 12 Pro 128gb and add to cart.",
"action_reprs": [
"[combobox] Search for anything -> TYPE: iPhone 12 Pro",
"[button] Search -> CLICK",
"[link] 128 GB - apply Storage Capacity filter -> CLICK",
"[heading] Apple iPhone 12 Pro - 128GB - All Colors - Unlocke... -> CLICK",
"[combobox] Please select a Color -> SELECT: Blue",
"[link] Add to cart -> CLICK"
]
},
{
"website": "ebay",
"id": "980d35af-6c00-4d6c-94cd-0c41e0fabb76",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Browse mens Timberland boots in size 9 and under $100 and filter by lowest price.",
"action_reprs": [
"[combobox] Search for anything -> TYPE: mens timberland boots",
"[button] Search -> CLICK",
"[link] 9 - apply US Shoe Size filter -> CLICK",
"[textbox] Maximum Value in $ -> TYPE: 100",
"[button] Submit price range -> CLICK",
"[button] Sort selector. Best Match selected. -> CLICK",
"[link] Price + Shipping: lowest first -> CLICK"
]
},
{
"website": "airbnb",
"id": "d070774f-9ca2-43c0-a7d0-221697791cf0",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Look for a place with a good swimming pool that charges between $200 and $300 per night.",
"action_reprs": [
"[img] -> CLICK",
"[span] Filters -> CLICK",
"[textbox] min price $ -> TYPE: 200",
"[textbox] max price $ -> TYPE: 400",
"[link] Show 664 stays -> CLICK"
]
},
{
"website": "enterprise",
"id": "8b079ace-b202-4d78-a9b0-4cde39e58934",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Find a vehicle at New York JFK International Airport May 2-May 5 for an owner above 25 years.",
"action_reprs": [
"[searchbox] Pick-up & Return Location (ZIP, City or Airport) (... -> TYPE: New York JFK",
"[option] New York JFK International Airport JFK Jamaica, 11... -> CLICK",
"[button] Selected Pick-Up Date 03/19/2023 -> CLICK",
"[button] Next Month -> CLICK",
"[button] 05/02/2023 -> CLICK",
"[button] Date -> CLICK",
"[button] 05/05/2023 -> CLICK",
"[button] Browse Vehicles -> CLICK"
]
},
{
"website": "espn",
"id": "969f36c3-52e7-42da-80bd-11a2d04d53ae",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Show me the Biography of the NFL player named Michael Jordan",
"action_reprs": [
"[button] Open Search -> CLICK",
"[textbox] Search -> TYPE: Michael Jordan",
"[textbox] Search -> ENTER",
"[span] Michael Jordan -> CLICK",
"[link] Bio -> CLICK"
]
},
{
"website": "espn",
"id": "ac35e5a5-f52f-4886-9a23-65f0a6492c5e",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Find FC Barcelona's next fixture in the Spanish Copa de Rey",
"action_reprs": [
"[li] Soccer -> HOVER",
"[link] Barcelona -> CLICK",
"[link] Fixtures -> CLICK",
"[select] All Competitions -> SELECT: Spanish Copa del Rey"
]
},
{
"website": "espn",
"id": "b1a1f767-8611-4539-9c08-475011d38e12",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Find the latest news about Mikal Bridges",
"action_reprs": [
"[button] Open Search -> CLICK",
"[textbox] Search -> TYPE: Mikal Bridges",
"[span] Nets' Mikal Bridges on pace for 83 games, and GM s... -> CLICK"
]
},
{
"website": "espn",
"id": "bb31a9f4-3465-4a91-aae6-bf70aa6b729f",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Play a podcast about F1",
"action_reprs": [
"[link] \ue028 -> CLICK",
"[link] F1 -> CLICK",
"[span] The Gab & Juls Show -> CLICK",
"[span] -> CLICK",
"[button] Play Video -> CLICK"
]
},
{
"website": "kohls",
"id": "2d92911a-b208-4d68-ad00-46d2d67f9efa",
"domain": "Shopping",
"subdomain": "Department",
"confirmed_task": "Locate a store in spring, Texas.",
"action_reprs": [
"[link] Store Locator -> CLICK",
"[textbox] Please enter City, State, or Zip Code -> TYPE: SPRING, TX",
"[div] Spring, TX, US -> CLICK",
"[link] Click to submit search form -> CLICK",
"[link] Spring -> CLICK"
]
},
{
"website": "new.mta.info",
"id": "00deddc4-8991-47b5-92f1-f9eb88011b16",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find all outdoor events this month in NYC",
"action_reprs": [
"[span] Special events -> CLICK",
"[DisclosureTriangle] All locations -> CLICK",
"[li] NYC -> CLICK",
"[DisclosureTriangle] All Categories -> CLICK",
"[li] Outdoors -> CLICK",
"[DisclosureTriangle] All Dates -> CLICK",
"[li] This month -> CLICK",
"[link] Apply -> CLICK"
]
},
{
"website": "new.mta.info",
"id": "0cbdfafd-822f-4f61-bb57-05fc146752ce",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "check car toll rate for bridges and tunnels",
"action_reprs": [
"[span] Menu -> CLICK",
"[span] Agencies -> CLICK",
"[link] Bridges & Tunnels -> CLICK",
"[div] Tolls by vehicle -> CLICK",
"[span] Cars -> CLICK"
]
},
{
"website": "new.mta.info",
"id": "13a676be-2f4f-4abf-83fb-4ab641793801",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Get a list of Administrative and Clerical jobs MTA is currently recruiting for in Brooklyn",
"action_reprs": [
"[link] Careers -> CLICK",
"[link] See all open MTA positions. -> CLICK",
"[textbox] Enter a Location -> TYPE: brooklyn",
"[button] Search -> CLICK",
"[link] Administrative & Clerical 15 jobs -> CLICK"
]
},
{
"website": "new.mta.info",
"id": "1a038b20-cd5a-4c32-8b11-fe2aeeb4ec85",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "View Fares from Grand Central to Stoney Brook for Port Jefferson after 10:00pm for adult.",
"action_reprs": [
"[link] Fares & Tolls -> CLICK",
"[link] See railroad fare details. -> CLICK",
"[link] Plan a trip to see fares. -> CLICK",
"[searchbox] From -> TYPE: grand central",
"[span] Grand Central -> CLICK",
"[searchbox] To -> CLICK",
"[div] Recent Stations -> CLICK",
"[searchbox] To -> TYPE: stoney brook",
"[span] Stony Brook -> CLICK",
"[select] 1 -> SELECT: 10",
"[select] 00 -> SELECT: 00",
"[link] Find Schedules -> CLICK",
"[link] Edit -> CLICK",
"[button] 04/11/2023 -> CLICK",
"[link] 12, Wednesday April 2023 -> CLICK",
"[link] Find Schedules -> CLICK",
"[div] Earlier -> CLICK",
"[generic] Press enter key to get details about this schedule -> CLICK",
"[tab] Fares -> CLICK"
]
},
{
"website": "new.mta.info",
"id": "1a833106-368a-41e4-a36e-32f6b1d36d16",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Plan a trip with the least amount of walking from Central Park Zoo to the Broadway Theater.",
"action_reprs": [
"[searchbox] From -> TYPE: central park zoo",
"[listitem] Central Park Zoo, East 64th Street, New York, NY, ... -> CLICK",
"[searchbox] To -> CLICK",
"[searchbox] To -> TYPE: broadway",
"[listitem] Broadway Theatre, Broadway, New York, NY, USA -> CLICK",
"[button] Open Travel Preferences modal. -> CLICK",
"[combobox] Minimize my -> SELECT: Walking",
"[button] Done button - Press enter key to submit travel pre... -> CLICK",
"[link] Plan my Trip - Press enter key to submit the form ... -> CLICK"
]
},
{
"website": "budget",
"id": "44a12ff5-0172-444a-b979-f224162c1aa8",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Search for cars to pick up at the laguardia airport in April 12th, 2023 midnight\n and return to same location at noon",
"action_reprs": [
"[button] Locations -> CLICK",
"[link] Find a Location -> CLICK",
"[textbox] Search by Airport, City, Zip, Address or Attractio... -> TYPE: laguardia airport",
"[span] LaGuardia Airport -> CLICK",
"[button] Find a Location -> CLICK",
"[link] 1 Laguardia Airport (LGA)\u00a0 -> CLICK",
"[combobox] Pick Up Time -> SELECT: midnight",
"[textbox] Enter your pick-up location or zip code -> CLICK",
"[combobox] Return Time -> SELECT: noon",
"[textbox] Return to same location -> CLICK",
"[button] Select My Car -> CLICK"
]
},
{
"website": "budget",
"id": "4c997e24-d185-4730-84d6-f8cb512f4c03",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Search for car options to pick up at any location near 10023 on april 12 at 3 am",
"action_reprs": [
"[textbox] Enter your pick-up location or zip code -> TYPE: 10023",
"[span] , 10023 -> CLICK",
"[textbox] mm/dd/yyyy -> CLICK",
"[link] 12 -> CLICK",
"[combobox] Pick Up Time -> SELECT: 3:00 AM",
"[button] Select My Car -> CLICK",
"[link] Close -> CLICK",
"[button] Select My Car -> CLICK"
]
},
{
"website": "united",
"id": "d22ce493-c49c-43f7-939c-4a429797c2a3",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Book me a flight from BWI to NYC for 2 for August 2nd-August 7th",
"action_reprs": [
"[combobox] Enter your departing city, airport name, or airpor... -> CLICK",
"[combobox] Enter your departing city, airport name, or airpor... -> TYPE: BWI",
"[button] Baltimore, MD, US (BWI) -> CLICK",
"[combobox] Enter your destination city, airport name, or airp... -> TYPE: NYC",
"[button] New York, NY, US (NYC - All Airports) -> CLICK",
"[textbox] Depart -> CLICK",
"[button] Move forward to switch to the next month. -> CLICK",
"[button] Move forward to switch to the next month. -> CLICK",
"[button] Wednesday, August 2, 2023 -> CLICK",
"[button] Monday, August 7, 2023 -> CLICK",
"[button] 1 Adult -> CLICK",
"[button] Substract one Adult -> CLICK",
"[section] Flight -> CLICK",
"[button] Find flights -> CLICK"
]
},
{
"website": "amctheatres",
"id": "05e1f2bd-3498-4fcb-8d43-37c903397ded",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Check the balance for a gift card with the number 1000000000000000 and pin 1222",
"action_reprs": [
"[link] Visit the Gift Cards page -> CLICK",
"[link] Check Balance -> CLICK",
"[spinbutton] Gift Card Number -> TYPE: 1000000000000000",
"[spinbutton] Gift Card Pin -> TYPE: 1222",
"[button] Search -> CLICK"
]
},
{
"website": "amctheatres",
"id": "130b1cd5-3e2f-4676-aea4-24ba9706171b",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Browse the on demand sales section and rent a film in HD format.",
"action_reprs": [
"[link] Visit the On Demand page -> HOVER",
"[link] On Sale Now -> CLICK",
"[img] movie poster for Elvis -> CLICK",
"[button] Rent from $3.99 -> CLICK",
"[option] Rent -> CLICK"
]
},
{
"website": "amctheatres",
"id": "22509b64-b643-44ec-b486-9828e686303c",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "View the full menu for AMC Dine-In",
"action_reprs": [
"[link] Visit the Food & Drinks page -> HOVER",
"[link] Explore Menu -> CLICK",
"[link] View Full Menu -> CLICK"
]
},
{
"website": "espn",
"id": "6a7eaba3-f6ec-4eba-9e04-ff974b228ef4",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Select an event from the 2019 UFC schedule and show me the full profile from one of the athletes",
"action_reprs": [
"[link] MMA -> HOVER",
"[link] Schedule/Results -> CLICK",
"[select] 2023 -> SELECT: 2019",
"[select] All -> SELECT: UFC",
"[link] UFC Fight Night: Edgar vs. The Korean Zombie -> CLICK",
"[link] Full Profile -> CLICK"
]
},
{
"website": "espn",
"id": "7a632871-a6a8-40fd-b48f-6fea49cf48da",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "check the NBA score board on March 11th",
"action_reprs": [
"[link] NBA -> CLICK",
"[link] Scores -> CLICK",
"[use] -> CLICK",
"[listitem] 11 -> CLICK"
]
},
{
"website": "yelp",
"id": "2e15efa0-f646-4dc4-9ce0-2e3d155c788b",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Find the highest-rated mover in Honolulu to shift a vehicle and large appliances out of state and who has virtual discussion options available.",
"action_reprs": [
"[link] Home Services -> HOVER",
"[span] Movers -> CLICK",
"[textbox] Near -> TYPE: HONOLULU",
"[span] Honolulu -> CLICK",
"[checkbox] Vehicle -> CLICK",
"[checkbox] Large appliances -> CLICK",
"[radio] Out-of-state -> CLICK",
"[button] Virtual Consultations -> CLICK",
"[button] Recommended -> CLICK",
"[span] Highest Rated -> CLICK"
]
},
{
"website": "rei",
"id": "2eaf60d5-d2af-4f50-a3ad-5cc9132a770a",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Buy the cheapest used women's running shoes available in a size 5",
"action_reprs": [
"[link] Used Gear -> CLICK",
"[menuitem] Women's -> CLICK",
"[menuitem] Running Shoes -> CLICK",
"[label] 5 (10) -> CLICK",
"[combobox] Sort By: -> SELECT: Price: Low - High",
"[img] -> CLICK",
"[radio] 5 -> CLICK",
"[radio] GRADE_A -> CLICK",
"[button] Add To Cart -> CLICK",
"[link] Confirm Membership to Checkout -> CLICK",
"[input] -> TYPE: Joe",
"[input] -> TYPE: Bloggs",
"[input] -> TYPE: 123456789",
"[button] Proceed to checkout -> CLICK"
]
},
{
"website": "rei",
"id": "486bdb13-16c5-4a53-8566-a60caaf94a73",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Buy a GoBites Uno Spork in the color magenta and have it delivered to a store in Seattle, WA. Checkout with default address, and use credit number 123456789, CVV 123, expire 01, 2024",
"action_reprs": [
"[searchbox] Search -> TYPE: gobites uno spork",
"[button] Search -> CLICK",
"[img] humangear GoBites Uno Spork 0 -> CLICK",
"[button] Color: Magenta -> CLICK",
"[span] -> CLICK",
"[button] Change store -> CLICK",
"[searchbox] Search by location -> TYPE: Seattle, WA",
"[button] Search by location -> CLICK",
"[button] Add to cart -> CLICK",
"[link] Cart & Checkout -> CLICK",
"[link] Proceed to checkout -> CLICK",
"[button] Continue with this address -> CLICK",
"[button] Continue without membership -> CLICK",
"[button] Continue -> CLICK",
"[button] Continue -> CLICK",
"[textbox] Credit card number -> TYPE: 123456789",
"[combobox] Expiration month \u00a0* -> TYPE: 01",
"[combobox] Expiration year \u00a0* -> SELECT: 2024",
"[textbox] Security code -> TYPE: 123"
]
},
{
"website": "newegg",
"id": "13d78369-994a-4202-a9ed-8361e1fdea9d",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "Browse bluetooth headphones with active noise-cancellation.",
"action_reprs": [
"[searchbox] Search Site -> TYPE: headphones",
"[button] \uf002 -> CLICK",
"[span] Active -> CLICK",
"[button] APPLY -> CLICK",
"[span] Bluetooth -> CLICK",
"[button] APPLY -> CLICK"
]
},
{
"website": "soundcloud",
"id": "9e9d7935-0c16-46e6-9e5c-3ea9124a6bf7",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Browse the top 50 hip hop chart and play the top track, then add this track to a newly created private playlist named Top Hip Hop.",
"action_reprs": [
"[link] Hip-hop & Rap -> CLICK",
"[div] Play -> CLICK",
"[button] More -> CLICK",
"[button] Add to playlist -> CLICK",
"[a] Create a playlist -> CLICK",
"[textbox] Playlist title * -> TYPE: Top Hip Hop",
"[div] -> CLICK",
"[button] Save -> CLICK",
"[button] Close -> CLICK"
]
},
{
"website": "soundcloud",
"id": "a338a731-596c-456e-9a9f-25f9e284309e",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Make a playlist and add 3 songs from popular Selena Gomez tracks and name it Love.",
"action_reprs": [
"[searchbox] Search -> TYPE: Selena Gomez",
"[button] Search -> CLICK",
"[link] Selena Gomez -> CLICK",
"[link] Popular tracks -> CLICK",
"[button] More -> CLICK",
"[button] Add to playlist -> CLICK",
"[a] Create a playlist -> CLICK",
"[textbox] Playlist title * -> TYPE: Love",
"[button] Save -> CLICK",
"[button] Close -> CLICK",
"[button] More -> CLICK",
"[button] Add to playlist -> CLICK",
"[button] Add to playlist -> CLICK",
"[button] Close -> CLICK",
"[button] More -> CLICK",
"[button] Add to playlist -> CLICK",
"[button] Add to playlist -> CLICK",
"[button] Close -> CLICK"
]
},
{
"website": "thetrainline",
"id": "f122e4c9-7634-4193-94f9-8623cd75d1f1",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find tickets from Manchester Piccadilly to any station in London on April 8, leaving nearest 10 AM for 1 adult",
"action_reprs": [
"[combobox] Departure station, none selected. Select a station... -> CLICK",
"[combobox] Departure station, none selected. Select a station... -> TYPE: Manchester",
"[span] Manchester Piccadilly -> CLICK",
"[span] London -> CLICK",
"[textbox] Date use format: 16-Mar-23 -> CLICK",
"[link] 8 -> CLICK",
"[listbox] hour -> SELECT: 10",
"[button] Get cheapest tickets -> CLICK"
]
},
{
"website": "gamestop",
"id": "a513befc-46c3-4bb6-87c0-8f219107c756",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Add a NBA basketball game for the PS5 to the shoping cart",
"action_reprs": [
"[searchbox] Search games, consoles & more -> TYPE: nba2k23",
"[button] Search -> CLICK",
"[img] NBA 2K23 - PlayStation 5 -> CLICK",
"[button] Add to Cart -> CLICK"
]
},
{
"website": "gamestop",
"id": "bd4b77db-00a5-405f-bf0a-a4d168967d64",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "find Panini Diamond Kings Baseball cards set below $25.",
"action_reprs": [
"[searchbox] Search games, consoles & more -> TYPE: Panini Diamonds Kings Baseball cards",
"[button] Search -> CLICK",
"[img] Panini Diamond Kings Baseball Cards Blaster Box - ... -> CLICK"
]
},
{
"website": "gamestop",
"id": "c14078dd-a4be-4784-a46b-cb01333e3019",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Add two $50 playstation store gift cards to cart",
"action_reprs": [
"[button] Main Menu -> CLICK",
"[button] Gift Cards -> CLICK",
"[img] -> CLICK",
"[img] -> CLICK",
"[button] Add to Cart -> CLICK",
"[img] -> CLICK",
"[button] Add to Cart -> CLICK",
"[button] View Cart & Checkout -> CLICK"
]
},
{
"website": "gamestop",
"id": "d86d5cc1-50f7-4bfd-8e5b-60db84e87956",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Check the trade-in value for Call of Duty: Black Ops III for Xbox One.",
"action_reprs": [
"[searchbox] Search games, consoles & more -> TYPE: trade in",
"[button] Search -> CLICK",
"[p] Video Games -> CLICK",
"[searchbox] Find values for games and more -> TYPE: Black Ops",
"[link] Call of Duty: Black Ops III - Xbox One -> CLICK"
]
},
{
"website": "gamestop",
"id": "f52ba76c-e5fc-48e5-85f3-41d4234a5c5f",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find used Xbox series X available.",
"action_reprs": [
"[button] Main Menu -> CLICK",
"[button] Consoles & Hardware chevron_right -> CLICK",
"[button] Xbox Series X|S -> CLICK",
"[link] Filter -> CLICK",
"[generic] Refine by Category: Consoles -> CLICK",
"[button] Condition -> CLICK",
"[checkbox] Pre-Owned Pre-Owned -> CLICK",
"[button] Done -> CLICK"
]
},
{
"website": "united",
"id": "28f6ac29-940a-4ec6-a8bd-16ae2ce69a1c",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Search receipt with the eTicket 12345678 for the trip reserved by Jason Two",
"action_reprs": [
"[tab] MY TRIPS -> CLICK",
"[link] Find a receipt -> CLICK",
"[radio] Confirmation or eTicket number -> CLICK",
"[textbox] Confirmation or eTicket More information about con... -> TYPE: 12345678",
"[textbox] First name -> TYPE: Jason",
"[textbox] Last name -> TYPE: Two",
"[button] Search -> CLICK"
]
},
{
"website": "united",
"id": "2d18cb36-5628-49e8-a336-c25c153c5527",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find John Atas's trip with the confirmation number 1000001",
"action_reprs": [
"[tab] MY TRIPS -> CLICK",
"[li] My trips -> CLICK",
"[link] My trips -> CLICK",
"[textbox] Last name -> TYPE: Atas",
"[label] Confirmation number -> TYPE: 1000001",
"[button] Search -> CLICK"
]
},
{
"website": "espn",
"id": "e3016f6f-b0fe-46df-a5ae-d0ad80a6996c",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Find the schedule for the Dallas Mavericks.",
"action_reprs": [
"[link] NBA -> HOVER",
"[link] Dallas Mavericks -> CLICK",
"[link] Schedule -> CLICK"
]
},
{
"website": "yelp",
"id": "84f19aba-ad0a-46db-84bb-c279b5353b8a",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Browse cafes that have outdoor seating and is dog friendly.",
"action_reprs": [
"[textbox] Find -> TYPE: cafe",
"[span] Cafe -> CLICK",
"[button] All -> CLICK",
"[button] See all -> CLICK",
"[checkbox] Outdoor Seating -> CLICK",
"[checkbox] Dogs Allowed -> CLICK",
"[button] Add -> CLICK"
]
},
{
"website": "yelp",
"id": "8e200503-9b49-48aa-aaf6-3d6692b5cb50",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Search for locksmiths near Texas City, Texas that provide virtual consultations and are open now.",
"action_reprs": [
"[link] Home Services -> CLICK",
"[textbox] Near -> TYPE: Texas City, Texas",
"[button] Search -> CLICK",
"[button] Open Now -> CLICK",
"[button] Virtual Consultations -> CLICK"
]
},
{
"website": "amazon",
"id": "04b8b406-a031-48a3-a002-b1791d872e16",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Add $100 Google Play Gift Card to cart and recipient email address as abc@abc.com",
"action_reprs": [
"[textbox] Search Amazon -> TYPE: Google Play",
"[button] google play gift card -> CLICK",
"[img] Sponsored Ad - Google Play gift code - give the gi... -> CLICK",
"[button] $100 -> CLICK",
"[textbox] To -> TYPE: abc@abc.com",
"[button] Add to cart -> CLICK"
]
},
{
"website": "cvs",
"id": "5b433cc4-26bf-4e62-b406-f00dc09c274d",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Add a CVS brand covid home test kit to the cart.",
"action_reprs": [
"[img] -> CLICK",
"[span] Shop all at-home COVID-19 tests -> CLICK",
"[div] CVS Health At Home COVID-19 Test Kit, 2 CT -> CLICK",
"[button] Add CVS Health At Home COVID-19 Test Kit, 2 CT to ... -> CLICK"
]
},
{
"website": "foxsports",
"id": "af97084c-5b72-4fec-be1e-dcab0980b335",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Check all Bayern Munich goalie stats",
"action_reprs": [
"[button] MORE -> CLICK",
"[div] Soccer -> CLICK",
"[div] Bundesliga -> CLICK",
"[div] Bayern Munich -> CLICK",
"[heading] STATS -> CLICK",
"[link] GOALS Jamal Musiala Jamal Musiala 11 G -> CLICK",
"[heading] GOALS -> CLICK"
]
},
{
"website": "foxsports",
"id": "c254dcec-bd9b-4cf0-9225-9d2bf1345f38",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Check Real Madrid player Vinicius Junior bio",
"action_reprs": [
"[button] MORE -> CLICK",
"[div] Soccer -> CLICK",
"[link] La Liga La Liga -> CLICK",
"[div] Real Madrid -> CLICK",
"[heading] ROSTER -> CLICK",
"[heading] Vinicius Junior -> CLICK",
"[heading] BIO -> CLICK"
]
},
{
"website": "foxsports",
"id": "e6c7934b-6949-46ee-8f72-edb46abd3da7",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "check the winning odds in the Champions League for Real Madrid against Chelsea.",
"action_reprs": [
"[span] Odds -> CLICK",
"[heading] SOCCER -> CLICK",
"[heading] ENGLISH PREMIER LEAGUE -> CLICK",
"[link] UEFA CHAMPIONS LEAGUE -> CLICK",
"[heading] GAMES -> CLICK",
"[button] Open bet slip modal -> HOVER"
]
},
{
"website": "ign",
"id": "5ad0f114-6cea-4f61-af3d-f9f4d4096d6c",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Add Uncharted: Legacy of Thieves Collection to my guide and find the Queen's bracelet information.",
"action_reprs": [
"[link] Guides -> CLICK",
"[svg] -> CLICK",
"[searchbox] Search -> TYPE: Uncharted Legacy of Thieves Collection",
"[div] Uncharted: Legacy of Thieves Collection -> CLICK",
"[button] Open Guide -> CLICK",
"[button] Table of Contents -> CLICK",
"[link] Uncharted: Legacy of Thieves Collection - Wiki Bun... -> CLICK",
"[link] Collectibles -> CLICK",
"[link] The Queen's Bracelet -> CLICK"
]
},
{
"website": "uniqlo",
"id": "9c9e89c1-fdb9-424c-b544-b9fd2f1ef46e",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Search for Limited Time Offers available in the Kids section and filter by size, 11-12Y(150).",
"action_reprs": [
"[link] KIDS -> CLICK",
"[link] Limited-Time Offers -> CLICK",
"[gridcell] Size -> CLICK",
"[label] 11-12Y(150) -> CLICK",
"[svg] -> CLICK"
]
},
{
"website": "uniqlo",
"id": "ad381d87-53a0-4aa1-a1e5-d6d172a905cd",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Show all the women cropped tops with lowest price first.",
"action_reprs": [
"[link] WOMEN -> CLICK",
"[link] Cropped Tops -> CLICK",
"[generic] Sort by -> CLICK",
"[option] Price: Low to high -> CLICK"
]
},
{
"website": "uniqlo",
"id": "b30b9f84-0541-4826-a3af-98220b851f7c",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Search for women's sports wear, size S.",
"action_reprs": [
"[svg] -> CLICK",
"[searchbox] Search by keyword -> TYPE: sports wear",
"[svg] -> CLICK",
"[heading] Gender > Category -> CLICK",
"[input] -> CLICK",
"[option] WOMEN -> CLICK",
"[heading] Size -> CLICK",
"[label] S -> CLICK"
]
},
{
"website": "uniqlo",
"id": "b5cb859d-8460-4b27-b6c9-d6fea6de9889",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Find kids 13Y size t shirts and add 3 to cart.",
"action_reprs": [
"[link] KIDS -> CLICK",
"[link] T-Shirts -> CLICK",
"[gridcell] Size -> CLICK",
"[label] 13Y(160) -> CLICK",
"[svg] -> CLICK",
"[img] AIRism Cotton Graphic Short-Sleeve Raglan T-Shirt -> CLICK",
"[input] -> CLICK",
"[option] 3 -> CLICK",
"[button] ADD TO CART -> CLICK"
]
},
{
"website": "ign",
"id": "c53a4a47-d155-42fc-b9a8-6b37d092d9aa",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Find the release date and supported platforms for the game \"Elden Ring.\"",
"action_reprs": [
"[button] Search -> CLICK",
"[searchbox] Search -> TYPE: Elden Ring"
]
},
{
"website": "ign",
"id": "d637c171-dc6e-4a4e-a162-9c230e822932",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Show popular news which is at number one in comics.",
"action_reprs": [
"[button] News -> CLICK",
"[link] Comics -> CLICK",
"[link] Dec 1, 2022 The 10 Best Star Wars Video Games of A... -> CLICK"
]
},
{
"website": "ign",
"id": "db289bef-3d18-43c6-8ee3-a1ebc5d285b4",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Show me news about the ps5.",
"action_reprs": [
"[path] -> CLICK",
"[searchbox] Search -> TYPE: ps5"
]
},
{
"website": "travelzoo",
"id": "c5cc7e71-6fd6-4a33-b450-89565dcff0a3",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Find deals for Hotels in Mexico.",
"action_reprs": [
"[textbox] What type of deals? -> TYPE: Hotels",
"[div] Hotels -> CLICK",
"[textbox] Where? -> TYPE: Mexico",
"[div] Mexico -> CLICK",
"[button] SEARCH DEALS -> CLICK"
]
},
{
"website": "travelzoo",
"id": "c8990751-0aab-440c-bf6d-a32ac1216344",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Find guided vacations in Europe for more than 10 nights in the month of July",
"action_reprs": [
"[textbox] What type of deals? -> CLICK",
"[div] Vacations -> CLICK",
"[textbox] Where? -> CLICK",
"[textbox] Where? -> TYPE: Europe",
"[div] Europe -> CLICK",
"[textbox] When? -> CLICK",
"[tab] Select a Month -> CLICK",
"[li] July -> CLICK",
"[button] SEARCH DEALS -> CLICK",
"[button] Filter -> CLICK",
"[button] 10+ Night Trips -> CLICK",
"[button] Guided Trips -> CLICK",
"[button] DONE -> CLICK"
]
},
{
"website": "flightaware",
"id": "2ff0909b-a8bb-4370-8428-9d355f5c6a67",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Open the most popular photos of the Adam A-500 model aircraft.",
"action_reprs": [
"[span] Community -> HOVER",
"[link] Highest Ranked -> CLICK",
"[combobox] Aircraft -> SELECT: Adam A-500 (twin-piston) (26)"
]
},
{
"website": "flightaware",
"id": "30e310ca-af64-46b4-a0f6-14b8f04fa734",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Look up Popular Photos in the Community featuring Aegean Airlines",
"action_reprs": [
"[span] Community -> CLICK",
"[link] Popular Photos -> CLICK",
"[select] All Airlines -> SELECT: Aegean Airlines \"Aegean\" (AEE) (452)"
]
},
{
"website": "flightaware",
"id": "44284a24-b3de-44ef-bcfc-abf57c3f791a",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find the status of flight #039028",
"action_reprs": [
"[input] -> TYPE: 039028",
"[img] Submit Search -> CLICK"
]
},
{
"website": "flightaware",
"id": "52a8bace-f14c-41ce-980f-50d95e5ac259",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Show the list of countries with the highest number of seen aircrafts.",
"action_reprs": [
"[link] ADS-B -> HOVER",
"[link] Statistics -> CLICK",
"[div] Top Countries -> CLICK"
]
},
{
"website": "flightaware",
"id": "ca80bb42-2617-4f29-bbcd-bcc426b3e407",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find Airport information of Camarillo Airport, CA and check weather.",
"action_reprs": [
"[combobox] Search Method -> SELECT: Airport",
"[textbox] Airport City (e.g. New York) -> TYPE: Camarillo",
"[strong] Camarillo -> CLICK",
"[img] Submit Search -> CLICK",
"[link] View KCMA Airport Stats -> CLICK",
"[link] WEATHER -> CLICK"
]
},
{
"website": "instacart",
"id": "10b2af14-f708-4abe-94fc-00163d11cb56",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Create a new list and add four items from the personal care category at Walgreens.",
"action_reprs": [
"[svg] -> CLICK",
"[link] Your lists -> CLICK",
"[link] Create a list -> CLICK",
"[svg] -> CLICK",
"[span] Walgreens -> CLICK",
"[textbox] Add a title (Required) -> TYPE: Walgreens",
"[img] A person holding a tomato and a grocery bag with a... -> CLICK",
"[button] Next -> CLICK",
"[link] Personal Care -> CLICK",
"[svg] -> CLICK",
"[img] -> CLICK",
"[span] Add to list -> CLICK",
"[checkbox] Walgreens New -> CLICK",
"[button] Done -> CLICK",
"[path] -> CLICK",
"[path] -> CLICK",
"[path] -> CLICK",
"[svg] -> CLICK",
"[img] -> CLICK",
"[span] Add to list -> CLICK",
"[checkbox] Walgreens New -> CLICK",
"[button] Done -> CLICK",
"[path] -> CLICK",
"[link] View More -> CLICK",
"[img] -> CLICK",
"[span] Add to list -> CLICK",
"[checkbox] Walgreens New -> CLICK",
"[button] Done -> CLICK",
"[button] Back -> CLICK",
"[path] -> CLICK",
"[link] Shower Essentials -> CLICK",
"[img] -> CLICK",
"[span] Add to list -> CLICK",
"[checkbox] Walgreens New -> CLICK",
"[button] Done -> CLICK",
"[button] Back -> CLICK",
"[link] Lists -> CLICK"
]
},
{
"website": "ticketcenter",
"id": "acc194d4-2f71-496a-b378-e18ab698ab0f",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Find reggae concerts this weekend.",
"action_reprs": [
"[button] CONCERTS -> CLICK",
"[link] Reggae -> CLICK",
"[button] All dates -> CLICK",
"[link] This weekend -> CLICK"
]
},
{
"website": "ticketcenter",
"id": "bb02400d-e9da-416a-839a-0068f511a630",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Get WWE tickets for April 10 event happening in seattle, and book 4 cheapest lower level tickets.",
"action_reprs": [
"[link] WWE Tickets -> CLICK",
"[link] TICKETS -> CLICK",
"[p] Any Quantity -> CLICK",
"[label] 4 -> CLICK",
"[span] -> CLICK",
"[div] Lower -> CLICK",
"[button] $107/ea -> CLICK"
]
},
{
"website": "boardgamegeek",
"id": "61c8e051-a847-4424-9d8b-b8bc2c134a35",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Show me the recent trades",
"action_reprs": [
"[button] Shopping -> CLICK",
"[link] Trades -> CLICK",
"[link] Recent Trades -> CLICK"
]
},
{
"website": "boardgamegeek",
"id": "87d1206c-a16b-4816-9c1e-6e1a04f30bf6",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Add games with the title Atlantis to my collection.",
"action_reprs": [
"[combobox] Search -> TYPE: Atlantis",
"[svg] -> CLICK",
"[link] Atlantis -> CLICK",
"[button] \uf168 Add To Collection -> CLICK",
"[button] Save -> CLICK"
]
},
{
"website": "last.fm",
"id": "2bc47bba-32d7-406b-bb39-c6f2b2f2039a",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Favorite the top rock track",
"action_reprs": [
"[link] Music -> CLICK",
"[link] rock -> CLICK",
"[button] Love this track -> CLICK"
]
},
{
"website": "last.fm",
"id": "39fd14c2-3bdd-4ca6-8a3a-1a6e7374c8e6",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Find a woman t-shirt in xl size from merchandise section, add 2 pieces to the cart and check out.",
"action_reprs": [
"[link] Merchandise -> CLICK",
"[span] Women's Last.fm Spiral Hex Tee -> CLICK",
"[select] S -> SELECT: XL",
"[svg] -> CLICK",
"[button] ADD TO CART -> CLICK",
"[path] -> CLICK",
"[button] Check Out -> CLICK"
]
},
{
"website": "thetrainline",
"id": "5b37d2e1-cbf7-4465-b28b-b63b0754895b",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Book a cheapest train ticket in upstairs deck and at least one window seat from Paris to Milan on March 26, departing after noon for 16 year old and 45 year old.",
"action_reprs": [
"[combobox] Departure station, none selected. Select a station... -> TYPE: PARIS",
"[span] Paris -> CLICK",
"[combobox] Arrival station, none selected. Select a station. -> TYPE: MILAN",
"[span] Milano (Milan) -> CLICK",
"[textbox] Date use format: 01-Apr-23 -> CLICK",
"[rect] -> CLICK",
"[link] 26 -> CLICK",
"[polyline] -> CLICK",
"[span] Youth -> CLICK",
"[combobox] Select passenger age -> SELECT: 16",
"[button] Done -> CLICK",
"[listbox] hour -> SELECT: 12",
"[listbox] minutes -> SELECT: 00",
"[button] Get cheapest tickets -> CLICK",
"[heading] Continue -> CLICK",
"[div] -> CLICK",
"[div] -> CLICK",
"[span] 36 -> CLICK",
"[button] 34 -> CLICK",
"[button] Confirm Seats -> CLICK",
"[button] Continue -> CLICK"
]
},
{
"website": "thetrainline",
"id": "b48c9974-4ba0-4112-98ce-3667781fa71b",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find a cheapest standard train ticket from London to Sheffield on March, 29, arriving by 10:45 am for 2 adults.",
"action_reprs": [
"[combobox] Departure station, none selected. Select a station... -> TYPE: london",
"[span] London -> CLICK",
"[combobox] Arrival station, none selected. Select a station. -> TYPE: sheffield",
"[span] Sheffield -> CLICK",
"[textbox] Date use format: 24-Mar-23 -> CLICK",
"[link] 29 -> CLICK",
"[listbox] Leaving at or Arrive by selector -> SELECT: Leaving at",
"[listbox] hour -> SELECT: 10",
"[listbox] minutes -> SELECT: 45",
"[svg] -> CLICK",
"[listbox] select adults -> SELECT: 2",
"[button] Done -> CLICK",
"[button] Get cheapest tickets -> CLICK",
"[button] OK, got it -> CLICK",
"[button] Continue -> CLICK"
]
},
{
"website": "ultimate-guitar",
"id": "4c3b2a4f-4b54-4724-9d8a-0ea95ab180c5",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Find forum threads which include the name Taylor Swift in the title within last month",
"action_reprs": [
"[link] Forums -> CLICK",
"[link] Advanced search -> CLICK",
"[textbox] Search by keyword -> TYPE: Taylor Swift",
"[combobox] Find Posts from -> SELECT: 1 Months Ago",
"[button] Search -> CLICK"
]
},
{
"website": "ultimate-guitar",
"id": "61d28a34-cc8e-46a9-b41d-c95933de2214",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Find all time popular drop c rock tab of beginner difficulty",
"action_reprs": [
"[link] Tabs -> CLICK",
"[link] Beginner 554,088 -> CLICK",
"[link] Drop C 3,930 -> CLICK",
"[link] Rock 2,420 -> CLICK",
"[link] Tab -> CLICK",
"[div] Today's most popular -> CLICK",
"[link] Most popular of all time -> CLICK"
]
},
{
"website": "ultimate-guitar",
"id": "759a1b1b-bb1f-4981-aef4-02a319f8dbaa",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Open the profile page for author of latest shot",
"action_reprs": [
"[link] Shots -> CLICK",
"[button] New -> CLICK",
"[link] mauritzwilshusen -> CLICK"
]
},
{
"website": "ultimate-guitar",
"id": "928ec908-ea23-42a4-8b13-3ca6f0721ead",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Filter search results for guitar tabs to only show songs with a difficulty rating of \"Beginner\"",
"action_reprs": [
"[link] Tabs -> CLICK",
"[link] Beginner 554,396 -> CLICK"
]
},
{
"website": "ultimate-guitar",
"id": "9326b908-cbe6-41f6-957f-00b84c26bfcc",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Find recently added guitar pro non-acoustic tab intros",
"action_reprs": [
"[link] Tabs -> CLICK",
"[link] Non-acoustic 1,805,658 -> CLICK",
"[link] Intro 65,171 -> CLICK",
"[link] Guitar Pro -> CLICK",
"[div] Today's most popular -> CLICK",
"[link] Recently added -> CLICK"
]
},
{
"website": "ultimate-guitar",
"id": "a8de57df-b0be-400d-9211-931321c6500c",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Add the best rated ukulele tab to my favorites",
"action_reprs": [
"[textbox] Enter artist name or song title -> TYPE: ukulele",
"[b] ukulele -> CLICK",
"[link] Tab -> CLICK",
"[link] High rated -> CLICK",
"[link] Far Cry 3 - Ukulele Girl -> CLICK",
"[button] ADD TO FAVORITES -> CLICK"
]
},
{
"website": "ultimate-guitar",
"id": "b332a3c6-c4f5-423c-a207-b1bcb28db6c3",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Find the highest rated Drop D guitar tab from the 1990s.",
"action_reprs": [
"[link] Tabs -> CLICK",
"[link] Drop D 39,730 -> CLICK",
"[link] 1990s 3,183 -> CLICK",
"[div] Today's most popular -> CLICK",
"[link] Rating -> CLICK",
"[link] Everlong -> CLICK"
]
},
{
"website": "yellowpages",
"id": "8b4e49e9-9802-4c1f-acb3-de06e38445e7",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Find beauty salons that are rated A and accept coupons in Seattle, WA.",
"action_reprs": [
"[input] -> TYPE: beauty salons",
"[link] Beauty Salons -> CLICK",
"[input] -> TYPE: Seattle, WA",
"[link] Seattle, WA -> CLICK",
"[link] Seattle, WA -> CLICK",
"[button] Find -> CLICK",
"[span] Coupons -> CLICK",
"[span] BBB Rated A+/A -> CLICK"
]
},
{
"website": "yellowpages",
"id": "91f56f3b-e3de-4d57-95df-f976a11c64f7",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Find a veterinarian emergency service for dogs in Hawaii with a BBB rating of A+",
"action_reprs": [
"[link] Veterinarians -> CLICK",
"[input] -> TYPE: hawaii",
"[link] Hawaii, HI -> CLICK",
"[button] Find -> CLICK",
"[link] All -> CLICK",
"[label] Veterinarians -> CLICK",
"[label] Veterinarian Emergency Services -> CLICK",
"[heading] Features -> CLICK",
"[label] BBB Rated A+/A -> CLICK",
"[button] Apply Filters -> CLICK"
]
},
{
"website": "koa",
"id": "a39f20a6-4d31-4f5f-b0ac-be8d548d7fa5",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Show the hot deals within 500 miles from 10001",
"action_reprs": [
"[link] DEALS \uf0d7 -> CLICK",
"[link] HOT DEALS \uf0da -> CLICK",
"[textbox] City, State or Zip -> TYPE: 10001",
"[span] -> CLICK",
"[combobox] Show results within\u00a0 -> SELECT: 500 Miles"
]
},
{
"website": "koa",
"id": "a92a83ca-25ff-4751-8754-c65ef858699d",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Show me the Lava Hot Springs East KOA photo gallery.",
"action_reprs": [
"[textbox] WHERE DO YOU WANT TO GO? -> TYPE: Lave Hot Springs East KOA",
"[list] KOA Logo Icon Lava Hot Springs West KOA Holiday La... -> CLICK",
"[button] FIND A KOA -> CLICK",
"[link] PHOTOS -> CLICK"
]
},
{
"website": "koa",
"id": "08a0c5cc-41a9-4eb8-b3ea-91d9e26f8bd3",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Get directions for the Koa resort campground in Arizona",
"action_reprs": [
"[link] CAMPING AT KOA \uf0d7 -> CLICK",
"[link] KOA RESORT CAMPGROUNDS \uf0da -> CLICK",
"[button] Arizona -> CLICK",
"[link] Tucson / Lazydays KOA Resort\ue250 -> CLICK",
"[link] \uf3c5Get Directions -> CLICK"
]
},
{
"website": "koa",
"id": "117b1d5c-1e54-4588-ba84-aa173887b067",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Renew a existing KOA rewards account with the rewards number 1000000001 e postal code 10023",
"action_reprs": [
"[link] REWARDS PROGRAM -> CLICK",
"[link] PURCHASE OR RENEW NOW \ue080 -> CLICK",
"[radio] RENEW - An Existing Account -> CLICK",
"[textbox] KOA Rewards Number -> TYPE: 1000000001",
"[textbox] Postal Code -> TYPE: 10023",
"[button] \u00a0 Continue \uf054 -> CLICK"
]
},
{
"website": "koa",
"id": "39358d9c-6db2-4662-a91e-47a416eeacf7",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "See what deals there are for Dish Outdoor.",
"action_reprs": [
"[link] DEALS \uf0d7 -> CLICK",
"[link] DISH OUTDOORS \uf0da -> CLICK"
]
},
{
"website": "koa",
"id": "4970cd99-ce6b-42e3-bc78-695c9d510f6c",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Use the trip planner for a trip between Cheyenne, WY and Helena, MT.",
"action_reprs": [
"[link] FIND A CAMPGROUND \uf0d7 -> CLICK",
"[link] TRIP PLANNER \uf0da -> CLICK",
"[textbox] Enter your Origin -> TYPE: Cheyenne",
"[textbox] Enter your Destination -> TYPE: Helena",
"[button] Get Directions -> CLICK",
"[li] Cheyenne, WY, USA -> CLICK",
"[li] Helena, Montana -> CLICK",
"[button] Continue -> CLICK"
]
},
{
"website": "koa",
"id": "6d338fef-6d40-4f08-a045-861ddbc3d9f4",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Browse glamping locations in Northern California.",
"action_reprs": [
"[link] WAYS TO STAY \uf0d7 -> CLICK",
"[link] GLAMPING \uf0da -> CLICK",
"[link] glamping near you -> CLICK",
"[link] California -> CLICK"
]
},
{
"website": "ticketcenter",
"id": "5b85b4e5-60cb-42e6-af73-a6a45f8fc49d",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Find tickets as gifts and book 2 tickets for stand-up comedian Dave Chappelle and the roots shows.",
"action_reprs": [
"[link] Tickets as Gifts \u2013 Best Tickets to Buy Online -> CLICK",
"[link] Dave Chapelle -> CLICK",
"[link] TICKETS -> CLICK",
"[p] Any Quantity -> CLICK",
"[label] 2 -> CLICK",
"[button] $340/ea -> CLICK"
]
},
{
"website": "ticketcenter",
"id": "5e01c2f7-c63b-4826-98a3-a18f731e16ea",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Browse tickets for Chicago Bears games.",
"action_reprs": [
"[button] SPORTS -> HOVER",
"[tab] NFL -> CLICK",
"[link] Chicago Bears -> CLICK"
]
},
{
"website": "ticketcenter",
"id": "6a56a1fb-f201-4bf9-b225-842181920388",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Show events in Los Angeles and select the one on the Friday this weekend.",
"action_reprs": [
"[button] CITY GUIDES -> HOVER",
"[link] Los Angeles -> CLICK",
"[button] All dates -> CLICK",
"[link] This weekend -> CLICK",
"[link] TICKETS -> CLICK"
]
},
{
"website": "aa",
"id": "708cbe51-b493-41da-afa8-648564133972",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Show me the Flight schedules and notifications for a flight outside the us from BHZ to EWN leaving on april 30",
"action_reprs": [
"[link] Flight status -> CLICK",
"[link] Create flight status notification -> CLICK",
"[span] -> CLICK",
"[textbox] From , required. -> TYPE: bhz",
"[a] BHZ - Belo Horizonte, Brazil -> CLICK",
"[textbox] To , required. -> TYPE: ewn",
"[a] EWN - Coastal Carolina Regional, NC -> CLICK",
"[button] \udbf8\udc3a View Calendar: To navigate the calendar, use the... -> CLICK",
"[link] 30 -> CLICK",
"[button] Search -> CLICK"
]
},
{
"website": "aa",
"id": "7b05f537-af7a-4fd7-972b-123ce5a34294",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Check status of flight 6944 on April 6",
"action_reprs": [
"[link] Flight status -> CLICK",
"[span] Flight number -> CLICK",
"[spinbutton] Flight number , required. -> CLICK",
"[spinbutton] Flight number , required. -> TYPE: 6944",
"[combobox] Date -> SELECT: Thursday, April 6",
"[button] Search -> CLICK"
]
},
{
"website": "seatgeek",
"id": "c50985ee-d4d0-4a9e-ac6f-97bede200abd",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "check the lowest price ticket including fees to the next M3 Rock Festival - 2 Day Pass",
"action_reprs": [
"[link] Music -> HOVER",
"[link] Festivals -> HOVER",
"[link] M3 Rock Festival -> CLICK",
"[span] From $86 -> CLICK",
"[button] Low prices -> CLICK",
"[button] Include fees -> CLICK"
]
},
{
"website": "seatgeek",
"id": "c7058499-3dc9-4175-9142-d22416d25a1f",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "search the best VIP seat to the Red Hot Chili Peppers 2023 Tour",
"action_reprs": [
"[link] Music -> HOVER",
"[a] Genres -> HOVER",
"[link] Jazz -> CLICK",
"[img] Image for Red Hot Chili Peppers 2023 Tour -> CLICK",
"[button] VIP -> CLICK",
"[button] Read more -> CLICK"
]
},
{
"website": "kohls",
"id": "21f5aaaa-d54e-42a6-91c0-d1a427533963",
"domain": "Shopping",
"subdomain": "Department",
"confirmed_task": "Show me the new arrivals on Easter home decor",
"action_reprs": [
"[textbox] Search by keyword or web id -> TYPE: easter home decor",
"[span] easter home decor -> CLICK",
"[link] Sort by: Featured -> CLICK",
"[link] New Arrivals -> CLICK"
]
},
{
"website": "kohls",
"id": "2b29b7d1-bd80-4d2c-a491-9dfc89827e84",
"domain": "Shopping",
"subdomain": "Department",
"confirmed_task": "Browse best selling black hoodies in mens size Big and Tall that is between $25 and $50.",
"action_reprs": [
"[textbox] Search by keyword or web id -> TYPE: mens black hoodie",
"[span] mens black hoodie -> CLICK",
"[div] Size Range -> CLICK",
"[link] Big & Tall (5,552) -> CLICK",
"[div] Price -> CLICK",
"[link] $25 to $50 (2,237) -> CLICK",
"[link] Sort by: Featured -> CLICK",
"[link] Best Sellers -> CLICK"
]
},
{
"website": "kayak",
"id": "e9f5f0d0-7241-4a28-b387-c65a0ce52a61",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Search for a rental car in Miami, FL for pick up at the airport and drop off at a different location within the same city.",
"action_reprs": [
"[link] Search for cars -> CLICK",
"[svg] -> CLICK",
"[tab] Different drop-off -> CLICK",
"[textbox] Pick-up location -> CLICK",
"[textbox] Pick-up location -> TYPE: Miami Airport",
"[span] Miami -> CLICK",
"[textbox] Drop-off location -> CLICK",
"[textbox] Drop-off location -> TYPE: Miami",
"[span] Miami, Florida, United States -> CLICK",
"[svg] -> CLICK"
]
},
{
"website": "kayak",
"id": "eee72e78-71bd-434b-ba74-33888ea5522d",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "book the cheapest hotel in Le maraise neighborhood in paris with 2 room for 3 adult on March 27th to April 2nd.",
"action_reprs": [
"[link] Search for hotels -> CLICK",
"[textbox] Enter a city, hotel, airport, address or landmark -> TYPE: Le maraise",
"[span] Le Marais, Paris, France -> CLICK",
"[div] 27 -> CLICK",
"[div] 2 -> CLICK",
"[button] Search -> CLICK",
"[button] Number of rooms and guests -> CLICK",
"[button] Increment -> CLICK",
"[button] Increment -> CLICK",
"[div] Update -> CLICK",
"[div] Distance -> CLICK",
"[tab] Price (low to high) -> CLICK"
]
},
{
"website": "tvguide",
"id": "02e7bae3-c67f-4227-b6ea-7b87d111202a",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Show latest documentaries on Netflix and add the one with 70+ metascore.",
"action_reprs": [
"[link] What to Watch on Netflix -> CLICK",
"[button] Filter -> CLICK",
"[button] Documentary -> CLICK",
"[button] Release Date -> CLICK",
"[button] View Results -> CLICK",
"[span] Watchlist -> CLICK"
]
},
{
"website": "tvguide",
"id": "0dd0b532-7bac-4b3e-b5a4-2ca6b0897af6",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Browse comedy TV shows streaming on HBO Max that was released in 2010.",
"action_reprs": [
"[link] What to Watch on HBO Max -> CLICK",
"[button] Filter -> CLICK",
"[button] Comedy -> CLICK",
"[button] TV Shows -> CLICK",
"[span] 2010 -> CLICK",
"[button] View Results -> CLICK"
]
},
{
"website": "delta",
"id": "42f64db7-c573-4ba8-9cab-a390e2f5e535",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find a flight from Mumbai to New York City on 21st April, 2023.",
"action_reprs": [
"[link] From Departure Airport or City Your Origin -> TYPE: Mumbai",
"[link] BOM Mumbai, India -> CLICK",
"[link] To Destination Airport or City Your Destination -> CLICK",
"[textbox] Destination City or Airport -> TYPE: New York City",
"[link] NYC New York City Area Airports, NY -> CLICK",
"[combobox] Trip Type:, changes will reload the page -> CLICK",
"[option] One Way -> CLICK",
"[button] \ue908 Depart and Return Calendar Use enter to open, es... -> CLICK",
"[link] 21 April 2023, Friday -> CLICK",
"[button] done -> CLICK",
"[button] \ue91a SUBMIT -> CLICK",
"[link] Refundable Economy Classic Cabin class details for... -> CLICK"
]
},
{
"website": "us.megabus",
"id": "0592744b-ea69-4724-80f8-3924916b7758",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find out the cancellation policy",
"action_reprs": [
"[link] Help -> CLICK",
"[button] Can I cancel and/or get a refund for my reservatio... -> CLICK"
]
},
{
"website": "us.megabus",
"id": "122af0dc-9e4e-4c5a-98ad-5c4d02f32284",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find the next available bus from Chicago to Ann Arbor.",
"action_reprs": [
"[textbox] From (type text or use the arrow keys) -> TYPE: Chicago",
"[span] Chicago, IL -> CLICK",
"[textbox] To (type text or use the arrow keys) -> TYPE: Ann Arbor",
"[span] Ann Arbor, MI -> CLICK",
"[button] Find tickets -> CLICK"
]
},
{
"website": "foxsports",
"id": "0ad8d621-8f1a-4fc2-adf9-a78d363ebd3a",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Browse the most recent NASCAR driver news.",
"action_reprs": [
"[link] NASCAR Cup Series NASCAR -> CLICK",
"[button] Open More Dropdown -> CLICK",
"[heading] DRIVER NEWS -> CLICK"
]
},
{
"website": "foxsports",
"id": "14d4edf5-e5ca-40e8-8e5d-77068a22c32c",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "check the scores of the premiership on 19th of March.",
"action_reprs": [
"[span] Scores -> CLICK",
"[heading] SOCCER -> CLICK",
"[a] FEATURED MATCHES -> CLICK",
"[link] ENGLISH PREMIER LEAGUE -> CLICK",
"[div] -> CLICK",
"[div] -> CLICK",
"[div] 19 -> CLICK"
]
},
{
"website": "foxsports",
"id": "14f5587e-1353-419e-a381-f92d54ea2059",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Find bio information about Lebron James.",
"action_reprs": [
"[button] Search -> CLICK",
"[searchbox] Leagues, teams, players, shows, personalities... -> CLICK",
"[searchbox] Leagues, teams, players, shows, personalities... -> TYPE: Lebron James",
"[div] LeBron James -> CLICK",
"[heading] BIO -> CLICK"
]
},
{
"website": "carmax",
"id": "29fde741-075c-446c-8e8a-f432e81e7ac0",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Calculate vehicle price with a challenge credit score, monthly payment of $250 with a $3000 down payment and 24% APR for 48 months in Tennessee.",
"action_reprs": [
"[link] Finance -> CLICK",
"[link] Car payment calculator -> CLICK",
"[tab] Vehicle Price -> CLICK",
"[textbox] Monthly Payment -> TYPE: 250",
"[textbox] Down Payment -> TYPE: 3000",
"[combobox] State -> SELECT: Tennessee",
"[combobox] Credit Score -> SELECT: Challenged (< 580 FICO\u00ae Score)"
]
},
{
"website": "carmax",
"id": "5c91b907-39db-49c3-af73-5eb5c2390a93",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Find a store in Modesto California and set is as my store.",
"action_reprs": [
"[link] Find a store -> CLICK",
"[searchbox] Search carmax locations. -> TYPE: california",
"[button] Search. -> CLICK",
"[div] Modesto -> CLICK",
"[link] Visit Modesto store details. -> CLICK",
"[button] SET AS MY STORE -> CLICK"
]
},
{
"website": "carmax",
"id": "5d69e640-7765-4381-979c-9881afc048dd",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Calculate the monthly payment of a 15k car with a down payment of 5k in Michigan for a fair-rated person for a term length of 48 months, then shop with this budget for the cheapest car and add it to the favorites.",
"action_reprs": [
"[link] Finance -> CLICK",
"[link] Car payment calculator -> CLICK",
"[textbox] Vehicle Price -> TYPE: 15000",
"[textbox] Down Payment -> TYPE: 5000",
"[combobox] State -> SELECT: Michigan",
"[combobox] Credit Score -> SELECT: Fair (580-669 FICO\u00ae Score)",
"[combobox] Term Length -> SELECT: 48 months",
"[link] SHOP WITH BUDGET -> CLICK",
"[img] Car not saved -> CLICK"
]
},
{
"website": "kayak",
"id": "82f654ab-fbfe-43f2-a2fe-0001b2ac853f",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Search for flights from New York City to London and filter the results to show only non-stop flights.",
"action_reprs": [
"[svg] -> CLICK",
"[tab] One-way -> CLICK",
"[path] -> CLICK",
"[textbox] Flight origin input -> TYPE: New York City",
"[input] -> CLICK",
"[textbox] Flight destination input -> CLICK",
"[textbox] Flight destination input -> TYPE: London",
"[input] -> CLICK",
"[svg] -> CLICK",
"[div] -> CLICK",
"[div] -> CLICK"
]
},
{
"website": "kayak",
"id": "837989e0-7476-496a-be02-e4c69f1f989b",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find a cheapest one way flight from Mumbai to Dubai on 24 May.",
"action_reprs": [
"[button] Remove -> CLICK",
"[textbox] Flight origin input -> TYPE: Mumbai",
"[span] Chhatrapati Shivaji Intl -> CLICK",
"[textbox] Flight destination input -> TYPE: Dubai",
"[span] Dubai, United Arab Emirates -> CLICK",
"[svg] -> CLICK",
"[tab] One-way -> CLICK",
"[generic] Thursday May 18th -> CLICK",
"[div] 24 -> CLICK",
"[button] Search -> CLICK",
"[div] $141 -> CLICK",
"[div] View Deal -> CLICK"
]
},
{
"website": "budget",
"id": "bcc2b6df-c012-4513-9fc1-ab149e93001f",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Rent a 12-inch available moving truck with a complete protection package for approx 250 miles, pick it up at 4:00 pm, and drop it off at the same location on June 20 at 4:30 pm from zip 07718.",
"action_reprs": [
"[link] Rent a Moving Truck Budget Truck -> CLICK",
"[textbox] US City,State or Zip Code -> TYPE: 07718",
"[textbox] mm/dd/yyyy -> CLICK",
"[div] -> CLICK",
"[link] 20 -> CLICK",
"[select] Select Pick-up Time -> SELECT: 04:00 PM",
"[input] -> CLICK",
"[button] Find Your Truck -> CLICK",
"[button] Select Truck -> CLICK",
"[input] -> TYPE: 250",
"[button] Continue to Location -> CLICK",
"[select] Select a Pick-up Time -> SELECT: 04:00 PM",
"[select] 04:30 PM -> SELECT: 04:30 PM",
"[button] Select Pick-up Location -> CLICK",
"[button] Select -> CLICK",
"[link] Continue to next step -> CLICK"
]
},
{
"website": "budget",
"id": "c759aa6c-0738-4ac6-b03c-41d0f91ff4d3",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Book a SUV rental from Mar 31 (noon) to April 7, 2023 (noon) from Chicago O'hare Intl Airport, ORD and returning to same place with the lowest pay now price.",
"action_reprs": [
"[textbox] Enter your pick-up location or zip code -> TYPE: Harrt Reid Intl Airport, LAS",
"[textbox] Enter your pick-up location or zip code -> TYPE: Harry Reid Intl Airport, LAS",
"[generic] Close -> CLICK",
"[textbox] mm/dd/yyyy -> CLICK",
"[link] 31 -> CLICK",
"[link] 7 -> CLICK",
"[button] Select My Car -> CLICK",
"[generic] Close -> CLICK",
"[button] Select My Car -> CLICK",
"[generic] Close -> CLICK",
"[button] Reservations -> CLICK",
"[link] Make a Reservation -> CLICK",
"[textbox] Enter your pick-up location or zip code -> TYPE: Harry Reid Intl Airport, LAS",
"[span] , United States -> CLICK",
"[link] click here -> CLICK",
"[textbox] Search by Airport, City, Zip, Address or Attractio... -> TYPE: Ohare, Chicago",
"[span] , United States -> CLICK",
"[span] , Chicago -> CLICK",
"[link] Make a Reservation -> CLICK",
"[button] Select My Car -> CLICK",
"[link] All Vehicles (13) -> CLICK",
"[span] SUVs & Wagons (5) -> CLICK",
"[link] Pay Now -> CLICK"
]
},
{
"website": "cargurus",
"id": "dd13bc51-f582-4004-8641-eb4e62cabfc7",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Get prequalified with a good credit score for a $30000 car with a $6000 down payment for 48 months.",
"action_reprs": [
"[menuitem] Finance -> HOVER",
"[menuitem] Prequalify for Financing -> CLICK",
"[input] -> TYPE: 30000",
"[input] -> TYPE: 6000",
"[span] Good -> CLICK",
"[span] 48 mo -> CLICK",
"[span] Get pre-qualified -> CLICK",
"[button] Get started -> CLICK",
"[textbox] First name -> TYPE: john",
"[textbox] Last name -> TYPE: doew",
"[textbox] Email address -> TYPE: johndoew@gmail.com",
"[textbox] Phone number -> TYPE: 4533234565",
"[textbox] Social Security Number -> TYPE: 234567895",
"[textbox] Date of birth -> TYPE: 06/23/1992"
]
},
{
"website": "cargurus",
"id": "e832e1f9-3a9d-440e-a96f-8cbbf241e4af",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Sell my single-key black car, which has no defect with a leather interior through Louisiana, license plate number YAW639 in zip 70726 with mileage of 222900, get the offer at my email sellmycar@mail.com.",
"action_reprs": [
"[LabelText] Sell My Car -> CLICK",
"[textbox] Enter license plate -> TYPE: YAW639",
"[combobox] state -> SELECT: LA",
"[button] Get your offer -> CLICK",
"[textbox] ZIP Code -> TYPE: 70726",
"[button] Next -> CLICK",
"[textbox] Mileage -> TYPE: 222900",
"[button] Next -> CLICK",
"[span] -> CLICK",
"[div] Leather -> CLICK",
"[button] Next -> CLICK",
"[button] None -> CLICK",
"[combobox] CONDITION -> SELECT: Good",
"[combobox] TIRE_CONDITION -> SELECT: Good To Go",
"[button] No -> CLICK",
"[button] No -> CLICK",
"[button] No -> CLICK",
"[button] No -> CLICK",
"[radio] Owned -> CLICK",
"[button] No -> CLICK",
"[button] No -> CLICK",
"[button] No -> CLICK",
"[button] 1 -> CLICK"
]
},
{
"website": "viator",
"id": "04ec089f-2ae1-4fa9-bfdf-4dff9ab710ad",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find highest rated white water rafting experience available in Montana from May 1 to May 7",
"action_reprs": [
"[textbox] Where to? -> TYPE: Montana",
"[button] Montana USA -> CLICK",
"[button] Next -> CLICK",
"[gridcell] Mon May 01 2023 -> CLICK",
"[gridcell] Sun May 07 2023 -> CLICK",
"[button] Apply -> CLICK",
"[circle] -> CLICK",
"[button] -> CLICK",
"[button] -> CLICK",
"[div] White Water Rafting -> CLICK",
"[span] Featured -> CLICK",
"[span] Traveler Rating -> CLICK"
]
},
{
"website": "viator",
"id": "19847108-680f-4021-83a9-2548fab75fac",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Mark a review in the best rated activity to do in Paris in May 12, 2023 as he\nlpful",
"action_reprs": [
"[textbox] Where to? -> TYPE: Paris",
"[b] Paris -> CLICK",
"[button] Next -> CLICK",
"[button] Next -> CLICK",
"[gridcell] Fri May 12 2023 -> CLICK",
"[circle] -> CLICK",
"[svg] -> CLICK",
"[span] Traveler Rating -> CLICK",
"[img] 4.5 -> CLICK",
"[button] 2,693 Reviews -> CLICK",
"[button] Helpful -> CLICK"
]
},
{
"website": "newegg",
"id": "f4623be1-31c6-4546-a567-92bfd1da9cd7",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "Upgrade the count of the current SSD in my cart to 10",
"action_reprs": [
"[link] Shopping Cart -> CLICK",
"[textbox] qty -> TYPE: 10",
"[textbox] qty -> ENTER"
]
},
{
"website": "nfl",
"id": "03e45ce0-4375-44aa-b57f-cf439ccbe363",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Find the latest news article and send an email about it.",
"action_reprs": [
"[link] Jets signing former Packers QB Boyle to 1-year dea... -> CLICK",
"[use] -> CLICK",
"[link] Send email -> CLICK"
]
},
{
"website": "exploretock",
"id": "d311891e-82b9-4a16-ab46-6af92f054f94",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Check if 5pm is available to book a indoor reservation on 31st of March in Matthews Winery for 5 people",
"action_reprs": [
"[button] Search -> CLICK",
"[textbox] Search -> TYPE: Matthews winery",
"[span] Matthews Winery -> CLICK",
"[link] Book now Indoor Reservation, Two-hour indoor seati... -> CLICK",
"[button] 2023-03-31 -> CLICK",
"[i] -> CLICK",
"[i] -> CLICK",
"[i] -> CLICK",
"[button] 5:00 PM -> CLICK"
]
},
{
"website": "exploretock",
"id": "dadb0251-a77c-45d7-aacb-0bb2e70e2b56",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Find food delivery services of American cuision in New York for 4 people on March 20, 8 pm.",
"action_reprs": [
"[path] -> CLICK",
"[span] Delivery -> CLICK",
"[button] Change location -> CLICK",
"[svg] -> CLICK",
"[searchbox] Find a location -> TYPE: NEW YORK",
"[span] New York -> CLICK",
"[span] Mar 18 -> CLICK",
"[button] 20th March (Monday) -> CLICK",
"[combobox] Time -> SELECT: 8:00 PM",
"[combobox] Size -> SELECT: 4 guests",
"[button] Update search -> CLICK",
"[button] Edit cuisine type filter -> CLICK",
"[checkbox] American -> CLICK",
"[button] Submit -> CLICK"
]
},
{
"website": "gamestop",
"id": "5418beec-bc06-4e11-9664-4038fbdeefe9",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "List Batman collectible figures priced under 10 dollars and a customer rating above 4 with a same-day delivery option.",
"action_reprs": [
"[searchbox] Search games, consoles & more -> TYPE: BATMAN",
"[span] BATMAN -> CLICK",
"[link] Filter -> CLICK",
"[checkbox] Same Day Delivery Same Day Delivery -> CLICK",
"[generic] Refine by Category: Collectibles -> CLICK",
"[generic] Refine by Category: Figures -> CLICK",
"[link] $0 - $10 $0 - $10 -> CLICK",
"[button] Customer Rating -> CLICK",
"[checkbox] & up & Up -> CLICK",
"[button] Done -> CLICK"
]
},
{
"website": "gamestop",
"id": "693ae151-6a70-41b1-b016-87279c4c532e",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "find the cheapest xbox 360 game available for purchase",
"action_reprs": [
"[searchbox] Search games, consoles & more -> TYPE: xbox 360 games",
"[searchbox] Search games, consoles & more -> ENTER",
"[i] -> CLICK",
"[link] Price Low To High -> CLICK"
]
},
{
"website": "united",
"id": "14f0e837-af77-44b9-9cad-a8911aab30c6",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Search the status of flight from Columbus, number 1234 on April 5th, 2023.",
"action_reprs": [
"[heading] Flight status -> CLICK",
"[textbox] Flight number -> TYPE: 1234",
"[button] Search -> CLICK"
]
},
{
"website": "target",
"id": "eb9995b5-261b-4659-bebc-951e0f855d75",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Check the availability of a Nintendo Switch gaming console at the nearest Target store.",
"action_reprs": [
"[searchbox] Search: suggestions appear below -> TYPE: Nintendo Switch",
"[link] nintendo switch -> CLICK",
"[img] Nintendo Switch with Neon Blue and Neon Red Joy-Co... -> CLICK",
"[button] pickup - unselected - 1 of 3 - Ready within 2 hour... -> CLICK",
"[button] Check other stores -> CLICK"
]
},
{
"website": "tesla",
"id": "0fb1c90e-a494-4de9-86ac-d4e5366869c4",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Schedule a virtual consultation for Solar Roof. The name is James Smith. The address is 123 st rd. The emial address is abc@abc.com",
"action_reprs": [
"[link] Solar Roof -> CLICK",
"[link] Schedule a virtual consultation -> CLICK",
"[textbox] First Name -> TYPE: James",
"[div] -> TYPE: Smith",
"[input] -> TYPE: 123st rd",
"[textbox] Email Address -> TYPE: abc@abc.com",
"[checkbox] Solar Roof -> CLICK",
"[button] Submit -> HOVER"
]
},
{
"website": "tesla",
"id": "3b7cead3-475d-41a4-a018-db89c7ace632",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "What is the purchase price for powerwalls to install in a 200sqr feet 2 story house in the address 7528 East Mechanic Ave.Fargo, ND 58102",
"action_reprs": [
"[link] Powerwall -> CLICK",
"[link] Order Now -> CLICK",
"[textbox] Shipping Address -> TYPE: 7528 East Mechanic Ave. Fargo, ND 58102",
"[textbox] Shipping Address -> ENTER",
"[spinbutton] Home Square Footage -> TYPE: 200",
"[combobox] Number of Stories -> SELECT: Two-Story",
"[button] Next -> CLICK",
"[button] Next -> CLICK",
"[tab] Purchase Price -> CLICK"
]
},
{
"website": "tesla",
"id": "4985e844-15bc-4fa4-9a76-f2c6fb1e6c16",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Find me the cheapest red Model Y available to register in 94043",
"action_reprs": [
"[link] Model Y -> CLICK",
"[link] View Inventory -> CLICK",
"[image] -> CLICK",
"[combobox] Sort By -> SELECT: Price : low to high",
"[textbox] Registration Zip Code Where you will register the ... -> TYPE: 94043"
]
},
{
"website": "thetrainline",
"id": "c5a0a291-ef9c-408d-9505-af7aeb6f5280",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find the Railcard options for a 20 year old couple traveling within London and the South East",
"action_reprs": [
"[img] header.burgerMenu.title -> CLICK",
"[menuitem] Railcards -> CLICK",
"[combobox] How old are you? -> SELECT: 18-25",
"[combobox] Who do you usually travel with? -> SELECT: Couple",
"[combobox] Do you travel within London and the South East? -> SELECT: Yes"
]
},
{
"website": "thetrainline",
"id": "cd4df5fa-2c90-4a76-b4b0-0ca7bcdac2ee",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Reserve a train ticket with seat from Berlin to Zurich on March 31 after 8 am in aisle quite zone in side by side seat formation.",
"action_reprs": [
"[combobox] Departure station, none selected. Select a station... -> TYPE: BERLIN",
"[span] Berlin -> CLICK",
"[combobox] Arrival station, none selected. Select a station. -> TYPE: ZURICH",
"[span] Z\u00fcrich -> CLICK",
"[textbox] Date use format: 25-Mar-23 -> CLICK",
"[link] 31 -> CLICK",
"[listbox] hour -> SELECT: 08",
"[listbox] minutes -> SELECT: 00",
"[button] Get cheapest tickets -> CLICK",
"[div] -> CLICK",
"[heading] to next step -> CLICK",
"[div] -> CLICK",
"[div] -> CLICK",
"[div] -> CLICK",
"[span] Continue -> CLICK"
]
},
{
"website": "rottentomatoes",
"id": "30d5f7dc-3650-4177-93bc-b59f1f5621f0",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "List pg-13 comedy movies currently in theatres with the highest audience scores",
"action_reprs": [
"[link] MOVIES -> CLICK",
"[svg] -> CLICK",
"[select-label] Audience score (highest) -> CLICK",
"[span] Genre -> CLICK",
"[div] -> CLICK",
"[button] APPLY -> CLICK",
"[span] Rating -> CLICK",
"[div] -> CLICK",
"[button] APPLY -> CLICK"
]
},
{
"website": "espn",
"id": "627a99f1-b2e4-4ce4-93f5-89e691f8c879",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Find Kevin Durant's bio",
"action_reprs": [
"[button] Open Search -> CLICK",
"[textbox] Search -> TYPE: Kevin Durant",
"[link] Kevin Durant Phoenix Suns -> CLICK",
"[link] Bio -> CLICK"
]
},
{
"website": "espn",
"id": "6678924a-0a3d-4c8b-ac35-3ba0aceea4d5",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Find Golden State Warriors Player List.",
"action_reprs": [
"[button] Open Search -> CLICK",
"[textbox] Search -> TYPE: Golden State Warriors",
"[link] Golden State Warriors NBA -> CLICK",
"[link] Roster -> CLICK"
]
},
{
"website": "imdb",
"id": "f4555944-010b-48d2-a4cb-b7103c686bac",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Find the movie which won the jury prize in Cannes 2022, add the director of the movie to the new list named director and add \"to watch\" in the description of that list.",
"action_reprs": [
"[button] Open Navigation Drawer -> CLICK",
"[span] Cannes -> CLICK",
"[link] 2022 -> CLICK",
"[link] Eo -> CLICK",
"[button] \u200bJerzy Skolimowski -> CLICK",
"[button] Add to list -> CLICK",
"[menuitem] Create new list -> CLICK",
"[textarea] -> TYPE: Directors",
"[textarea] -> TYPE: To Watch",
"[combobox] Type of List * -> SELECT: People",
"[button] CREATE -> CLICK"
]
},
{
"website": "last.fm",
"id": "783d5a91-5f7e-4184-8467-e7ea88e81c5b",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Set the 3rd top hip hop track as my current obsession",
"action_reprs": [
"[link] Music -> CLICK",
"[link] hip-hop -> CLICK",
"[gridcell] Clint Eastwood -> CLICK",
"[button] More -> CLICK",
"[button] Set track as current obsession -> CLICK"
]
},
{
"website": "last.fm",
"id": "883fc533-d267-4eeb-8ccd-fe77bc28cd9b",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Discover Katy Perry and add bookmark to it and view all tracks.",
"action_reprs": [
"[link] Search -> CLICK",
"[textbox] Search -> TYPE: Katy Perry",
"[button] Search -> CLICK",
"[a] -> CLICK",
"[button] BOOKMARK -> CLICK",
"[button] OKAY -> CLICK",
"[link] View all tracks -> CLICK"
]
},
{
"website": "last.fm",
"id": "998d121b-c858-485d-9dd3-4609575d144b",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Find the most popular song this week by the no. 1 weekly charts ranked artist",
"action_reprs": [
"[link] Charts -> CLICK",
"[link] Weekly -> CLICK",
"[link] Taylor Swift -> CLICK",
"[tr] 1 -> CLICK"
]
},
{
"website": "newegg",
"id": "b467797c-5fab-4ee6-9b1f-ac6dc50c05cf",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "Find the lowest-priced single pack of Xerox genuine magenta toner sold by Newegg with free shipping.",
"action_reprs": [
"[link] \ue660 Computer Peripherals \uf105 -> CLICK",
"[link] Printer Ink & Toner \uf105 -> CLICK",
"[link] Xerox Toner -> CLICK",
"[span] Newegg -> CLICK",
"[button] APPLY -> CLICK",
"[span] Magenta -> CLICK",
"[button] APPLY -> CLICK",
"[span] Single Pack -> CLICK",
"[button] APPLY -> CLICK",
"[combobox] Featured Items \uf0d7 -> SELECT: Lowest Price"
]
},
{
"website": "united",
"id": "8b6eed27-39b4-4dbc-97d3-eeec13a8817d",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Book a roundtrip on July 1 from Mumbai to London and vice versa on July 5 for two adults and a 12-year-old in premium economy and if a flight is not available, search through the calendar for available flights.",
"action_reprs": [
"[combobox] Enter your departing city, airport name, or airpor... -> TYPE: MUMBAI",
"[button] Mumbai, IN (BOM) -> CLICK",
"[combobox] Enter your destination city, airport name, or airp... -> TYPE: LONDON",
"[button] London, GB (LON - All Airports) -> CLICK",
"[textbox] Depart -> CLICK",
"[button] Saturday, July 1, 2023 -> CLICK",
"[button] Wednesday, July 5, 2023 -> CLICK",
"[button] 1 Adult -> CLICK",
"[button] Substract one Adult -> CLICK",
"[button] Substract one Child -> CLICK",
"[generic] Economy -> CLICK",
"[option] Premium economy -> CLICK",
"[button] Find flights -> CLICK",
"[button] Search button opens in a same tab/Window -> CLICK"
]
},
{
"website": "rottentomatoes",
"id": "1203a016-d541-4914-9cdb-f042ad0abcf5",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Browse Anime TV shows and sorty by Newest",
"action_reprs": [
"[link] TV SHOWS -> CLICK",
"[svg] -> CLICK",
"[div] -> CLICK",
"[button] APPLY -> CLICK",
"[svg] -> CLICK",
"[div] -> CLICK"
]
},
{
"website": "rottentomatoes",
"id": "160fc162-7f03-4f59-83e1-5502d00806f2",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "See what is playing on Showtime sorted by newest.",
"action_reprs": [
"[link] TV SHOWS -> CLICK",
"[img] showtime -> CLICK",
"[svg] -> CLICK",
"[div] -> CLICK"
]
},
{
"website": "espn",
"id": "be5e5f14-c875-4cfd-a517-175619491b90",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Show me the NFL Scoreboard from the superbowl 2015",
"action_reprs": [
"[link] NFL -> CLICK",
"[link] Scores -> CLICK",
"[button] Calendar -> CLICK",
"[svg] -> CLICK",
"[svg] -> CLICK",
"[svg] -> CLICK",
"[svg] -> CLICK",
"[svg] -> CLICK",
"[use] -> CLICK",
"[svg] -> CLICK",
"[link] Super Bowl -> CLICK"
]
},
{
"website": "yelp",
"id": "41b8202c-9092-4307-ac58-2283c76df3b7",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Find Hot Dogs in Oakland, CA that Offers Delivery.",
"action_reprs": [
"[textbox] Near -> CLICK",
"[textbox] Near -> TYPE: Oakland, CA",
"[span] Oakland, CA -> CLICK",
"[textbox] Find -> CLICK",
"[textbox] Find -> TYPE: Hot Dogs",
"[span] Hot Dogs -> CLICK",
"[button] Offers Delivery -> CLICK"
]
},
{
"website": "yelp",
"id": "4777d638-204d-4e44-b81c-2fb43c471fb2",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Find the most reviewed cocktail bar with outdoor seating for reservation in San Francisco.",
"action_reprs": [
"[link] Restaurants -> HOVER",
"[span] Reservations -> CLICK",
"[textbox] Near -> TYPE: SAN FRANCISCO",
"[span] San Francisco -> CLICK",
"[checkbox] Cocktail Bars -> CLICK",
"[checkbox] Outdoor Seating -> CLICK",
"[button] Recommended -> CLICK",
"[span] Most Reviewed -> CLICK"
]
},
{
"website": "espn",
"id": "16886ec7-3301-4103-b175-9fa817335984",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Find the NBA team with the highest average points scored in the current season",
"action_reprs": [
"[button] NBA -> HOVER",
"[link] Stats -> CLICK",
"[link] Points -> CLICK"
]
},
{
"website": "ultimate-guitar",
"id": "d516b2f7-b180-422f-9e24-6fb778cb4b55",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Show me Ed Sheeran Chords & Tabs",
"action_reprs": [
"[textbox] Enter artist name or song title -> TYPE: Ed Sheeran",
"[b] ed sheeran -> CLICK"
]
},
{
"website": "ultimate-guitar",
"id": "da679cfe-9180-49f7-b8a2-a2b1bd6d8803",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Show me all the artists with smith in their name",
"action_reprs": [
"[textbox] Enter artist name or song title -> TYPE: smith",
"[button] SEARCH -> CLICK",
"[button] Tabs -> CLICK",
"[span] Artists -> CLICK"
]
},
{
"website": "soundcloud",
"id": "0a2623c8-ce74-4572-9eb6-89d0b216d0cf",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Follow Taylor Swift and add a playlist to next up.",
"action_reprs": [
"[searchbox] Search -> CLICK",
"[searchbox] Search -> TYPE: Taylor Swift",
"[button] Search -> CLICK",
"[link] Taylor Swift -> CLICK",
"[button] Follow -> CLICK",
"[link] Playlists -> CLICK",
"[span] Add to Next up -> HOVER"
]
},
{
"website": "uniqlo",
"id": "95619447-fe28-4cc0-9e0a-d888e5f73d7e",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "View the toddler collection and add one pair of the cheapest socks for a 6 months to 5 years to the wishlist.",
"action_reprs": [
"[link] BABY -> HOVER",
"[tab] Toddler (6M-5Y) -> CLICK",
"[link] All Toddler (6M-5Y) -> CLICK",
"[heading] Category -> CLICK",
"[input] -> CLICK",
"[option] Socks -> CLICK",
"[generic] Sort by -> CLICK",
"[option] Price: Low to high -> CLICK",
"[div] See more chips. -> CLICK",
"[img] Short Socks (2 Pairs) -> CLICK",
"[svg] -> CLICK",
"[button] Age18M-3Y(12-15cm) -> CLICK",
"[button] CLOSE -> CLICK"
]
},
{
"website": "qatarairways",
"id": "4c4ab02e-a617-490d-96c6-333d7fa82fe9",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Check the status of my upcoming trip with booking number 123456789 and last name Smith.",
"action_reprs": [
"[tab] \ue90cMy Trips -> CLICK",
"[textbox] booking reference -> TYPE: 123456789",
"[textbox] last name -> TYPE: Smith",
"[button] Retrieve booking -> HOVER"
]
},
{
"website": "enterprise",
"id": "67f9fb2d-443a-4e5b-9530-e24372faedd2",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "What are the exotic vehicles they have available to rent?",
"action_reprs": [
"[button] Vehicles -> CLICK",
"[link] Exotic Cars -> CLICK",
"[link] Explore Vehicles -> CLICK",
"[link] Learn More -> CLICK"
]
},
{
"website": "enterprise",
"id": "7180c4d1-971b-418d-8a64-87ab0d29c20e",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Find the lowest rent truck for 4 people, pick up from JFK airport at 11 am on March 27 and return at noon on March 30.",
"action_reprs": [
"[searchbox] Pick-up & Return Location (ZIP, City or Airport) (... -> TYPE: JFK",
"[span] New York -> CLICK",
"[button] Selected Pick-Up Date 03/22/2023 -> CLICK",
"[button] 03/27/2023 -> CLICK",
"[combobox] Pick-Up Time Selector -> SELECT: 11:00 AM",
"[button] Date -> CLICK",
"[button] 03/30/2023 -> CLICK",
"[button] Browse Vehicles -> CLICK",
"[checkbox] Trucks -> CLICK",
"[combobox] SORT BY -> SELECT: Low to High",
"[checkbox] 4+ -> CLICK",
"[button] Select Chevrolet Colorado Vehicle -> CLICK",
"[button] Continue to Review -> CLICK"
]
},
{
"website": "parking",
"id": "1b74fa2c-3236-45ac-9b4d-ff913112db52",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Search for parking near Sofi stadium that allows to pay with phone.",
"action_reprs": [
"[combobox] \uf002\u00a0 Enter an Address or Venue to find parking -> TYPE: sofi stadium",
"[span] SoFi Stadium -> CLICK",
"[strong] Filters -> CLICK",
"[checkbox] Parking and Pay with Phone icon Parking & Pay with... -> CLICK"
]
},
{
"website": "parking",
"id": "1f28fed3-bed9-444a-bf2b-3700b516b97f",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Search for a parking garage near Thalia Hall in Chicago that offers pre purchasing.",
"action_reprs": [
"[combobox] \uf002\u00a0 Enter an Address or Venue to find parking -> TYPE: Thalia Hall",
"[span] South Allport Street, Chicago, IL, USA -> CLICK",
"[strong] Filters -> CLICK",
"[checkbox] \uf109Pre-Purchased Available -> CLICK"
]
},
{
"website": "parking",
"id": "34e13beb-0235-41d4-b108-137cc7480904",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Book the cheapest parking spot for a standard car near 66 Perry St., New York, from April 20, 5:30 pm to April 21, 5:30 am.",
"action_reprs": [
"[link] CITIES -> CLICK",
"[span] Find your state -> CLICK",
"[link] New York -> CLICK",
"[link] New York -> CLICK",
"[span] Enter an Address or Venue to find parking -> TYPE: 66 perry st",
"[span] 66 -> CLICK",
"[span] Apr 18 -> CLICK",
"[gridcell] 20 -> CLICK",
"[span] 01:30PM -> CLICK",
"[link] 05:30PM -> CLICK",
"[span] Apr 20 -> CLICK",
"[gridcell] 21 -> CLICK",
"[span] 07:30PM -> CLICK",
"[link] 05:30AM -> CLICK",
"[button] SEARCH -> CLICK",
"[span] Distance -> CLICK",
"[link] Price -> CLICK",
"[button] Book now -> CLICK",
"[button] YES, PROCEED -> CLICK"
]
},
{
"website": "amazon",
"id": "61563837-99af-45e2-a13f-9d6bd9f74a81",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Show all the external solid state drives available with lowest price first.",
"action_reprs": [
"[button] Open Menu -> CLICK",
"[link] See All -> CLICK",
"[link] Computers -> CLICK",
"[link] Drives & Storage -> CLICK",
"[link] External Solid State Drives -> CLICK",
"[span] Sort by: -> CLICK",
"[option] Price: Low to High -> CLICK"
]
},
{
"website": "amazon",
"id": "6fd2fbb1-9f43-4c46-be42-569a892648e6",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Add a smartwatch to the cart that is compatible with an iPhone.",
"action_reprs": [
"[textbox] Search Amazon -> TYPE: smartwatch",
"[button] smartwatches -> CLICK",
"[i] -> CLICK",
"[img] Sponsored Ad - SKG V9C Smart Watch for Men Women, ... -> CLICK",
"[button] Add to Cart -> CLICK"
]
},
{
"website": "cabelas",
"id": "afb693cd-57cb-4468-9f7f-d965ee530913",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find the discount black insulated hunting boots for Men with average ratings over 3.5 stars",
"action_reprs": [
"[link] Bargain Cave -> CLICK",
"[link] Men's Shoes & Boots -> CLICK",
"[label] Boots -> CLICK",
"[label] Sale -> CLICK",
"[div] Color -> CLICK",
"[label] Black -> CLICK",
"[div] Average Ratings -> CLICK",
"[label] .Stars::before { -> CLICK"
]
},
{
"website": "cabelas",
"id": "e9a5ab90-517c-4323-a343-6e10e6b9632f",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find the gift registry of Carla Cahill, when asked for password use Michael Cahill as name and cahillm@gmail.com as email.",
"action_reprs": [
"[link] Gift Registry -> CLICK",
"[span] Find a Registry -> CLICK",
"[textbox] First Name -> TYPE: Carla",
"[textbox] Last Name -> TYPE: Cahill",
"[link] SEARCH -> CLICK",
"[span] View -> CLICK",
"[link] I don't have the password -> CLICK",
"[textbox] Your Name -> TYPE: Michael Cahill",
"[textbox] Your Email -> TYPE: cahillm@gmail.com",
"[link] REQUEST PASSWORD -> CLICK"
]
},
{
"website": "cabelas",
"id": "ee9e993b-0254-465d-bb04-072e01e5f498",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Browse the selection of fishing reels that are power assisted and are in stock.",
"action_reprs": [
"[link] Fishing -> CLICK",
"[menuitem] FISHING REELS -> CLICK",
"[link] Power Assisted Reels (6) -> CLICK",
"[label] In Stock -> CLICK"
]
},
{
"website": "cabelas",
"id": "eebf3f55-1a4d-4cdf-81c1-2fa3002bed6d",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find the cheapest Keen branded new pair of women's hiking shoes in the color brown, number 9, available in Columbus, Ohio store, average rating must be above 4.",
"action_reprs": [
"[link] Footwear -> CLICK",
"[menuitem] Hiking Boots -> CLICK",
"[svg] -> CLICK",
"[label] Brown -> CLICK",
"[svg] -> CLICK",
"[label] 9 -> CLICK",
"[label] Available in Store -> CLICK",
"[label] KEEN -> CLICK",
"[svg] -> CLICK",
"[label] .Stars::before { -> CLICK",
"[span] Sort by: -> CLICK",
"[div] Price (Low to High) -> CLICK"
]
},
{
"website": "yelp",
"id": "f738b393-9234-4c07-8baf-20f05627d5ed",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Find the highest-reviewed landscaper in West Hollywood for the design of lawn, who gives fast responses, and make sure he has a license verified by Yelp.",
"action_reprs": [
"[link] Home Services -> HOVER",
"[span] Landscaping -> CLICK",
"[textbox] Near -> TYPE: WEST HOLLYWOOD",
"[span] West Hollywood -> CLICK",
"[radio] Lawns or greenscapes -> CLICK",
"[button] Fast-responding -> CLICK",
"[button] Recommended -> CLICK",
"[span] Most Reviewed -> CLICK",
"[button] Verified License -> CLICK",
"[button] Got it -> CLICK"
]
},
{
"website": "yelp",
"id": "fd2e9403-3201-4bb7-a19d-f475960cf5be",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Browse Thai restaurants that offer delivery and have vegan options available.",
"action_reprs": [
"[textbox] Find -> TYPE: thai restaurants",
"[span] Thai Restaurants -> CLICK",
"[button] Offers Delivery -> CLICK",
"[span] 1 -> CLICK",
"[button] See all -> CLICK",
"[checkbox] Vegan -> CLICK",
"[button] Add -> CLICK"
]
},
{
"website": "united",
"id": "4770e887-f523-4609-a989-ded8c8abad19",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find a round trip economy flight from Pune to New York in June and select the fully refundable.",
"action_reprs": [
"[combobox] Enter your departing city, airport name, or airpor... -> TYPE: Pune",
"[button] Pune, IN (PNQ) -> CLICK",
"[combobox] Enter your destination city, airport name, or airp... -> TYPE: New York",
"[button] New York, NY, US (NYC - All Airports) -> CLICK",
"[button] Find flights -> CLICK",
"[button] Roundtrip $2,984 Select fare for Economy (fully re... -> CLICK"
]
},
{
"website": "ryanair",
"id": "6d87b507-14dd-4903-a131-fa089499ccb5",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find a flight From Dublin To Athens Greece for 1 Adult that leaves on April 1 and returns April 5th.",
"action_reprs": [
"[textbox] To -> CLICK",
"[button] Greece -> CLICK",
"[button] Athens -> CLICK",
"[div] Apr -> CLICK",
"[generic] 2 -> CLICK",
"[div] May 2023 -> CLICK",
"[div] Apr -> CLICK",
"[div] Choose date -> CLICK",
"[generic] 5 -> CLICK",
"[button] Search -> CLICK",
"[button] Select -> CLICK",
"[button] Select -> CLICK"
]
},
{
"website": "ryanair",
"id": "7219145b-ada1-480e-a8ea-f4fe164ca84a",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Book a one way ticket from Faro to Bournemouth leaving on 30th April, with a value fare, for a passenger named Mr. Joe Bloggs. Don't select now and only take 1 small bag onboard.",
"action_reprs": [
"[path] -> CLICK",
"[textbox] From -> TYPE: faro",
"[span] Faro -> CLICK",
"[textbox] To -> TYPE: bournemouth",
"[span] Bournemouth -> CLICK",
"[generic] 30 -> CLICK",
"[div] -> CLICK",
"[button] Search -> CLICK",
"[button] Select -> CLICK",
"[button] Continue for $ 148 . 16 -> CLICK",
"[button] Continue with Value fare -> CLICK",
"[button] Log in later -> CLICK",
"[button] - -> CLICK",
"[div] Mr -> CLICK",
"[textbox] First name -> TYPE: Joe",
"[textbox] Last name -> TYPE: Bloggs",
"[button] Continue -> CLICK",
"[button] Continue -> CLICK",
"[button] Okay, got it. -> CLICK",
"[img] undefined -> CLICK",
"[button] Continue without a seat -> CLICK",
"[div] 1 Small Bag only -> CLICK",
"[label] -> CLICK",
"[button] Continue -> CLICK",
"[button] No thanks -> CLICK",
"[button] Continue -> CLICK",
"[button] Continue -> CLICK"
]
},
{
"website": "eventbrite",
"id": "b5b56e9a-afef-4d1a-bd62-dddc058fdc81",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Search for an engineering open job in Madrid, Spain, if found apply with my details after picking office location, company success and career oppurtunity as applying reason. My name is James Smith and email is buckeye.foobar@gmail.com",
"action_reprs": [
"[link] Careers -> CLICK",
"[link] here -> CLICK",
"[checkbox] Engineering (41 items) -> CLICK",
"[checkbox] Spain (18 items) -> CLICK",
"[checkbox] Madrid (2 items) -> CLICK",
"[link] Title: IT Support Engineer -> CLICK",
"[textbox] First Name (as per passport) (required) -> TYPE: James",
"[textbox] Last Name (required) -> TYPE: Smith",
"[textbox] Email (required) -> TYPE: buckeye.foobar@gmail.com",
"[checkbox] Career opportunity Career opportunity -> CLICK",
"[checkbox] Office location Office location -> CLICK",
"[checkbox] Company success Company success -> CLICK",
"[button] Apply -> CLICK"
]
},
{
"website": "eventbrite",
"id": "cd8d723a-7a9f-4bd6-a8b9-75babb60835c",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Find information on how to get a ticket refund.",
"action_reprs": [
"[span] Help -> HOVER",
"[div] Visit the help center -> CLICK",
"[link] Request a refund -> CLICK"
]
},
{
"website": "uniqlo",
"id": "42657330-bfc5-425d-ae21-396a9ba1fb12",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Find yellow t-shirts for women small size that are less than $20.",
"action_reprs": [
"[link] WOMEN -> CLICK",
"[RootWebArea] Women's, Men's & Kids' Clothing & Accessories | UN... -> CLICK",
"[searchbox] Search by keyword -> TYPE: women t-shirts",
"[div] WOMEN / Tops -> CLICK",
"[gridcell] Size -> CLICK",
"[label] S -> CLICK",
"[gridcell] Color -> CLICK",
"[label] YELLOW -> CLICK",
"[gridcell] Price -> CLICK",
"[label] $10-$20 -> CLICK"
]
},
{
"website": "uniqlo",
"id": "7c28f4e3-3dcf-477b-98c3-087c4fc16655",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Locate a store which is nearest to 10017 zip code.",
"action_reprs": [
"[link] Store Locator -> CLICK",
"[searchbox] Postal code, address, store name -> TYPE: 10017",
"[path] -> CLICK",
"[button] UNIQLO 5th Ave 0.7 miles WOMEN, MEN, KIDS, BABY Fl... -> CLICK"
]
},
{
"website": "uniqlo",
"id": "7f94386a-d032-43cf-9dbe-2b64430c9c28",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "locate the store in IL",
"action_reprs": [
"[link] Store Locator -> CLICK",
"[input] -> CLICK",
"[option] IL -> CLICK"
]
},
{
"website": "uniqlo",
"id": "84d8a4df-0bba-45f9-b4c8-f5d455de451c",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Add one baby one piece to cart.",
"action_reprs": [
"[link] BABY -> CLICK",
"[link] One-Pieces -> CLICK",
"[img] Ribbed 1*1 Long-Sleeve One Piece Outfit -> CLICK",
"[button] ADD TO CART -> HOVER"
]
},
{
"website": "yellowpages",
"id": "4097c577-e637-4543-87a3-09b2f4734163",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Find a pedicure salon in New York and add two to favorites.",
"action_reprs": [
"[input] -> TYPE: pedicure salon",
"[input] -> TYPE: New York",
"[link] New York, NY -> CLICK",
"[button] Find -> CLICK",
"[link] Beauty & Youth Village Spa -> CLICK",
"[use] -> CLICK",
"[button] Find -> CLICK",
"[link] Fabio Doti Salon -> CLICK",
"[use] -> CLICK"
]
},
{
"website": "yellowpages",
"id": "40fbda9d-22c5-4aab-9798-3db50d981c5c",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Open the page to answer a question in the home improvement section.",
"action_reprs": [
"[link] QUESTIONS & ANSWERS -> CLICK",
"[link] Home Improvement Remodeling -> CLICK"
]
},
{
"website": "yellowpages",
"id": "4baa4918-3312-4b9b-9506-333057d6856b",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Search for coupons and deals in New York.",
"action_reprs": [
"[link] Coupons -> CLICK",
"[input] -> TYPE: new york",
"[link] New York, NY -> CLICK",
"[button] Find -> CLICK"
]
},
{
"website": "yellowpages",
"id": "62806bef-eeeb-4892-b4d5-6a8d2005c58d",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Browse the trending searches in Columbus.",
"action_reprs": [
"[link] CITY PAGES -> CLICK",
"[link] Columbus -> CLICK",
"[link] Search for more -> CLICK"
]
},
{
"website": "jetblue",
"id": "18a104dc-29e7-4777-9fee-1e023be1d686",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find ground operations jobs with JetBlue.",
"action_reprs": [
"[link] CareersExternal Link should open in a new window o... -> CLICK",
"[link] Ground Operations -> CLICK"
]
},
{
"website": "jetblue",
"id": "1ee63f83-8b6a-4883-813f-63f589e6e52b",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Book two rooms in the cheapest 3-star hotel which provides free breakfast, and free airport transportation for three adults, and one child from April 22 to 25 in texas city, the hotel should provide amenities for kids.",
"action_reprs": [
"[span] Stays -> CLICK",
"[button] Unlock deals External Link should open in a new wi... -> CLICK",
"[div] Search location -> TYPE: TEXAS CITY",
"[div] Texas City, TX -> CLICK",
"[textbox] Select a date range. -> CLICK",
"[img] Right -> CLICK",
"[gridcell] Choose Saturday, April 22nd 2023. It's available. -> CLICK",
"[gridcell] Choose Tuesday, April 25th 2023. It's available. -> CLICK",
"[button] 1\u00a0Room, 2\u00a0Guests Click to edit rooms and guests -> CLICK",
"[path] -> CLICK",
"[button] sub 1 -> CLICK",
"[div] open -> CLICK",
"[option] 6 -> CLICK",
"[button] Update -> CLICK",
"[button] Search -> CLICK",
"[button] Search without signing in -> CLICK",
"[span] -> CLICK",
"[span] -> CLICK",
"[span] -> CLICK",
"[span] -> CLICK",
"[div] Recommended -> CLICK",
"[option] Price (Low to High) -> CLICK",
"[heading] La Quinta Inn & Suites by Wyndham Houston Hobby Ai... -> CLICK",
"[button] Book now -> CLICK"
]
},
{
"website": "jetblue",
"id": "3c49d9c8-c3e4-402d-9a66-c34232975aa0",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find JetBlue press releases for the year 2020",
"action_reprs": [
"[link] Press RoomExternal Link should open in a new windo... -> CLICK",
"[link] View All Releases \uedbe -> CLICK",
"[combobox] Select year: -> SELECT: 2020",
"[combobox] Category: -> SELECT: Press Releases"
]
},
{
"website": "menards",
"id": "24de7f7d-f3f0-41a6-a578-e35b513b46e5",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find Maytag electric dryers that are at least 7.3 cubic foot costing less than $1000 that are available in store at Montgomery, Illinois with zip code 60538.",
"action_reprs": [
"[button] COLUMBUS, OH -> CLICK",
"[path] -> CLICK",
"[textbox] Zip Code -> TYPE: 60538",
"[link] Store Locator \u00a0 -> CLICK",
"[textbox] Zip Code -> TYPE: 60538",
"[button] Search By Zip Code -> CLICK",
"[button] MAKE MY STORE -> CLICK",
"[textbox] Search by SKU, Model # or Keyword -> TYPE: Magtag electric dryer",
"[button] Maytag in Electric Dryers -> CLICK",
"[checkbox] 7.3 cubic foot (5) -> CLICK",
"[checkbox] 7.4 cubic foot (6) -> CLICK",
"[span] Price -> CLICK",
"[img] expand -> CLICK",
"[spinbutton] Enter Minimum Price -> TYPE: 0",
"[spinbutton] Enter Maximum Price -> TYPE: 1000",
"[button] GO -> CLICK"
]
},
{
"website": "menards",
"id": "3d7f4f43-cff8-45fa-8249-97a8369c2d1f",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Send a 50-dollar home sweet home gift to my friend John with the message Congrats on your new home, and add this card to your cart and checkout.",
"action_reprs": [
"[link] Gifting -> CLICK",
"[link] Gift Cards -> CLICK",
"[div] Send a physical card through the mail. -> CLICK",
"[textbox] * Amount: -> TYPE: 50",
"[button] VIEW ALL -> CLICK",
"[img] -> CLICK",
"[textbox] To: -> TYPE: John",
"[textbox] From: -> TYPE: James",
"[textbox] Message: 200 characters remaining -> TYPE: Congrats on your new home.",
"[button] ADD TO CART -> CLICK",
"[button] CHECKOUT NOW -> CLICK"
]
},
{
"website": "menards",
"id": "40bf7303-ba39-44fe-b73f-ad3c9743c579",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find a 19-inch stainless steel kitchen sink with two equal bowls that could be shipped to my home and compare the top two cheapest.",
"action_reprs": [
"[button] Departments -> CLICK",
"[button] Kitchen -> CLICK",
"[link] Kitchen Sinks -> CLICK",
"[link] Drop In Two Bowl -> CLICK",
"[checkbox] Ship to Home Eligible (97) -> CLICK",
"[checkbox] Stainless Steel (75) -> CLICK",
"[checkbox] Equal Bowl (69) -> CLICK",
"[checkbox] 19 inch (7) -> CLICK",
"[button] Sort By: Best Match -> CLICK",
"[button] Price Low to High -> CLICK",
"[generic] Click to add item \"Tuscany\u00ae Baytown Drop-In 33\" St... -> CLICK",
"[generic] Click to add item \"Dayton Drop-In 25\" Stainless St... -> CLICK",
"[button] COMPARE -> CLICK"
]
},
{
"website": "viator",
"id": "8e133f6c-155d-4ba4-89f5-16f569d6e918",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find cheapest food tour in Paris which offers free cancellation",
"action_reprs": [
"[textbox] Where to? -> TYPE: Paris",
"[button] Paris France -> CLICK",
"[circle] -> CLICK",
"[button] -> CLICK",
"[div] Food Tours -> CLICK",
"[label] Free Cancellation -> CLICK",
"[span] Featured -> CLICK",
"[span] Price (Low to High) -> CLICK"
]
},
{
"website": "viator",
"id": "9b6316ee-4cfb-490e-bf52-9ee6cdded08b",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find ideas and recommendation for things to do in Cancun.",
"action_reprs": [
"[textbox] Where to? -> TYPE: cancun",
"[circle] -> CLICK",
"[span] Trip Inspiration -> HOVER",
"[link] Cancun -> CLICK"
]
},
{
"website": "ebay",
"id": "37c09901-63d4-4194-8a96-1d87ca8c37ae",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Browse washing machines available for free local pickup within 25 miles of zip code 90026.",
"action_reprs": [
"[combobox] Search for anything -> TYPE: washing machine",
"[button] Search -> CLICK",
"[textbox] Zip code -> TYPE: 90026",
"[button] Apply within filter -> CLICK",
"[input] -> CLICK"
]
},
{
"website": "cvs",
"id": "e92cd371-0bd2-4ac3-82e4-7fdaac46b626",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Add zyrtec to the cart for pickup at the nearest CVS to zip code 90028",
"action_reprs": [
"[combobox] Search products and services -> TYPE: zyrtec",
"[button] Search for zyrtec -> CLICK",
"[img] Zyrtec 24 Hour Allergy Relief Tablets with 10 mg C... -> CLICK",
"[button] Check More Stores -> CLICK",
"[textbox] Enter zip code or location. Please enter a valid l... -> TYPE: 90028",
"[img] -> CLICK",
"[generic] 6201 Hollywood Blvd., Suite 126 -> CLICK",
"[button] In Stock at 6201 Hollywood Blvd., Suite 126. 0.2 m... -> CLICK",
"[use] -> CLICK",
"[button] Add Zyrtec 24 Hour Allergy Relief Tablets with 10 ... -> CLICK"
]
},
{
"website": "cvs",
"id": "ff6ff6e5-e73c-4ba2-809e-59a1e269d68f",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find Hair Loss Evaluation and Treatment in 10018 and show directions.",
"action_reprs": [
"[button] Health -> CLICK",
"[button] load Health Services Menu -> CLICK",
"[link] Skin, Hair & Nails -> CLICK",
"[button] Hair Loss Evaluation & Treatment -> CLICK",
"[link] Hair Loss Evaluation & Treatment -> CLICK",
"[textbox] Tell us a location Enter a ZIP code or city & stat... -> TYPE: 10018",
"[button] Find care -> CLICK",
"[img] -> CLICK",
"[link] Clinic details of 1440 BROADWAY -> CLICK"
]
},
{
"website": "amazon",
"id": "862faed7-449c-4624-902b-6b512a977d0c",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Find the cheapest new surge protector with 6 to 8 outlets under 25 dollars with customer reviews above 4+, add 2 pieces to the cart.",
"action_reprs": [
"[textbox] Search Amazon -> TYPE: surge protector",
"[button] surge protector -> CLICK",
"[link] Surge Protectors -> CLICK",
"[link] 6 to 8 Outlets -> CLICK",
"[link] Under $25 -> CLICK",
"[region] 4 Stars & Up -> CLICK",
"[link] New -> CLICK",
"[span] Featured -> CLICK",
"[option] Price: Low to High -> CLICK",
"[img] Woods 41366 Surge Protector with Overload Safety F... -> CLICK",
"[span] Qty: -> CLICK",
"[option] 2 -> CLICK",
"[button] Add to Cart -> CLICK"
]
},
{
"website": "amazon",
"id": "884a375b-e3f4-4f34-8e99-290f49141f9a",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Find a dog bed on Amazon that is machine-washable and has a diameter of at least 30 inches.",
"action_reprs": [
"[textbox] Search Amazon -> TYPE: dog bed 30 inches",
"[button] Go -> CLICK",
"[RootWebArea] Amazon.com : dog bed 30 inches -> CLICK",
"[i] -> CLICK",
"[img] Sponsored Ad - Calming Dog Bed Cat Bed, Washable R... -> CLICK"
]
},
{
"website": "delta",
"id": "93f3a9a1-2fd8-4457-b689-d70b3249b99b",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "check flight status with flight number 2819 on 18th of March.",
"action_reprs": [
"[tab] FLIGHT STATUS -> CLICK",
"[button] \ue908 Search by date required selected as 15 March 202... -> CLICK",
"[link] 18 March 2023, Saturday -> CLICK",
"[button] done -> CLICK",
"[spinbutton] Flight Number (Required) -> TYPE: 2819",
"[button] \ue91a SUBMIT -> CLICK"
]
},
{
"website": "delta",
"id": "be5bae8d-bebc-4474-9d28-1cc633be8d8d",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find a cheapest hotel in New Delhi for 3 days starting from April 24 and add 3 to list.",
"action_reprs": [
"[tab] Travel Info -> CLICK",
"[link] Shop Hotels -> CLICK",
"[button] Going to -> TYPE: New Delhi",
"[button] New Delhi Delhi, India -> CLICK",
"[button] Check-out April 25, 2023 -> CLICK",
"[button] Apr 26, 2023 -> CLICK",
"[button] Done : (Save changes and close the date picker.) -> CLICK",
"[button] Search -> CLICK",
"[combobox] Sort by -> SELECT: Price: low to high",
"[svg] -> CLICK",
"[svg] -> CLICK",
"[svg] -> CLICK"
]
},
{
"website": "delta",
"id": "cf89b0ae-39ca-4451-80df-260d46c62f21",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find a hotel in Ohio From July 2nd to July 8th for 2 adults.",
"action_reprs": [
"[link] SHOP HOTELS -> CLICK",
"[button] Going to -> CLICK",
"[textbox] Going to -> TYPE: Ohio",
"[button] Ohio United States -> CLICK",
"[button] Check-in March 18, 2023 -> CLICK",
"[button] Next month -> CLICK",
"[button] Next month -> CLICK",
"[button] Next month -> CLICK",
"[button] Jul 2, 2023 -> CLICK",
"[button] Jul 8, 2023 -> CLICK",
"[button] Done : (Save changes and close the date picker.) -> CLICK",
"[button] Search -> CLICK"
]
},
{
"website": "qatarairways",
"id": "cd5d03cc-24a8-4284-ac43-b38579f416b1",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find the status of flights between Abidjan and Accra.",
"action_reprs": [
"[tab] \ue90aFlight status -> CLICK",
"[textbox] From / Flight number Autocomplete selection. Enter... -> TYPE: Abidjan",
"[strong] Abidjan -> CLICK",
"[textbox] To Autocomplete selection. Enter your place. -> TYPE: Accra",
"[strong] Accra -> CLICK",
"[button] Search flights -> CLICK"
]
},
{
"website": "qatarairways",
"id": "e437082b-8383-4322-aa58-a6a683113970",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find a hotel in Las Vegas that will cost two people the least for a week starting from 10, April",
"action_reprs": [
"[button] Book -> CLICK",
"[link] Hotels -> CLICK",
"[searchbox] Type your destination -> TYPE: Las Vegas",
"[option] Las Vegas Nevada,\u00a0United States -> CLICK",
"[checkbox] 10 April 2023 -> CLICK",
"[gridcell] 16 April 2023 -> CLICK",
"[button] Search -> CLICK",
"[button] Sort by:Our Top Picks -> CLICK",
"[span] Price (lowest first) -> CLICK"
]
},
{
"website": "amazon",
"id": "d64cbfc6-7ace-4cad-9f0a-6643cd83de6e",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Find the cheapest full-sized Amazon basic comforter with 4+ average customer reviews and priced between 50 to 100 dollars, if red color availabe in the cheapest product then add one to the cart.",
"action_reprs": [
"[textbox] Search Amazon -> TYPE: COMFORTER",
"[button] Go -> CLICK",
"[i] -> CLICK",
"[i] -> CLICK",
"[region] 4 Stars & Up -> CLICK",
"[link] $50 to $100 -> CLICK",
"[span] Featured -> CLICK",
"[option] Price: Low to High -> CLICK",
"[link] Amazon Basics 7-Piece Lightweight Microfiber Bed-i... -> CLICK",
"[button] Red Buffalo Plaid $57.81 In Stock. -> CLICK",
"[button] Add to Cart -> CLICK"
]
},
{
"website": "espn",
"id": "254a67f6-3e37-4f12-838d-2d9fb0cedbf0",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Show me the stats of the Athletic Club from spanish Laliga",
"action_reprs": [
"[li] Soccer -> CLICK",
"[link] Teams \ue00d -> CLICK",
"[select] UEFA Champions League -> SELECT: Spanish LaLiga",
"[link] Stats -> CLICK"
]
},
{
"website": "espn",
"id": "2a440d5f-1cc8-43de-86f5-ea181b0d12f8",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Who were the NBA season leaders from the 2020-21 regular season?",
"action_reprs": [
"[link] NBA -> CLICK",
"[link] Stats \ue00d -> CLICK",
"[button] Stats -> CLICK",
"[link] Season Leaders -> CLICK",
"[select] 2022-23 Postseason -> SELECT: 2020-21 Regular Season"
]
},
{
"website": "espn",
"id": "4b431888-9909-40b5-8351-be52905e4d5a",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Find the Real Madrid team schedule of the UEFA Champions League championship.",
"action_reprs": [
"[button] Open Search -> CLICK",
"[textbox] Search -> TYPE: Real Madrid",
"[link] Real Madrid LaLiga -> CLICK",
"[link] Fixtures -> CLICK",
"[select] All Competitions -> SELECT: UEFA Champions League"
]
},
{
"website": "airbnb",
"id": "0b2f241e-8d1f-4f22-be2f-5722ceff23a3",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Find a treehouse in India with free cancellation and below $100 per night.",
"action_reprs": [
"[img] -> CLICK",
"[button] Location Anywhere -> CLICK",
"[textbox] Where -> TYPE: India ",
"[div] India -> CLICK",
"[span] -> CLICK",
"[button] Filters -> CLICK",
"[textbox] max price $ -> CLICK",
"[textbox] max price $ -> TYPE: 99",
"[link] Show 1,000+ stays -> CLICK",
"[img] -> CLICK"
]
},
{
"website": "airbnb",
"id": "102c50a4-23f8-44ae-8300-43822b271dbf",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Add 3 places from OMG! below $500 to Wishlist and name it \"Togo\".",
"action_reprs": [
"[img] -> CLICK",
"[button] Filters -> CLICK",
"[textbox] max price $ -> TYPE: 500",
"[link] Show 684 stays -> CLICK",
"[path] -> CLICK",
"[textbox] Name -> TYPE: Togo",
"[button] Create -> CLICK",
"[path] -> CLICK",
"[div] Togo -> CLICK",
"[path] -> CLICK",
"[img] -> CLICK"
]
},
{
"website": "delta",
"id": "f84075a2-9d97-4964-9c80-70f5bee8a418",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find my trip with ticket number 3329456534543 along with my name John Green",
"action_reprs": [
"[tab] MY TRIPS -> CLICK",
"[combobox] Find Your Trip By -> CLICK",
"[option] Ticket Number -> CLICK",
"[input] -> TYPE: 3329456534543",
"[input] -> TYPE: John",
"[input] -> TYPE: Green",
"[button] \ue91a SUBMIT -> CLICK"
]
},
{
"website": "discogs",
"id": "29d6b448-a688-4c2f-8f6d-a13546d506d8",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Find the list of jazz albums released in 1890.",
"action_reprs": [
"[button] Explore -> CLICK",
"[link] Jazz -> CLICK",
"[link] 1890s -> CLICK"
]
},
{
"website": "discogs",
"id": "370a037c-c397-4adb-ab7c-0c388f448f68",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Find vinyl records at the lowest price.",
"action_reprs": [
"[button] Marketplace -> CLICK",
"[link] Vinyl -> CLICK",
"[combobox] Sort -> SELECT: Price Lowest"
]
},
{
"website": "us.megabus",
"id": "2ce0a80e-a049-434d-8b99-8343d2a0b21d",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Show me the location of the Altavista bus stop.",
"action_reprs": [
"[button] Explore\ue911 -> CLICK",
"[link] Bus stops -> CLICK",
"[button] Altavista, VA \ue911 -> CLICK",
"[button] Altavista Commons (Walmart parking lot) -> CLICK"
]
},
{
"website": "us.megabus",
"id": "2e2cb6d9-560c-4258-baed-82e0ed5b5dbc",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find bus stop information at Abbotsford, WI.",
"action_reprs": [
"[button] Explore\ue911 -> CLICK",
"[link] Bus stops -> CLICK",
"[button] Abbotsford, WI \ue911 -> CLICK",
"[button] Super 39 Shell -> CLICK"
]
},
{
"website": "marriott",
"id": "2ef470ab-b06a-4479-883f-78b4e3b94a04",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Find five star rated cultural tours in New York on May 7 with a max price of $75",
"action_reprs": [
"[button] For Guests\ue91e -> CLICK",
"[link] Activities \ue922 -> CLICK",
"[textbox] Location-Search -> TYPE: New York",
"[link] New York City New York, USA -> CLICK",
"[button] Select Activities -> CLICK",
"[span] Cultural Tours -> CLICK",
"[span] Any -> CLICK",
"[li] -> CLICK",
"[spinbutton] Max Price -> TYPE: 75",
"[span] mm/dd/yyyy-mm/dd/yyyy -> CLICK",
"[Abbr] May 7, 2023 -> CLICK",
"[Abbr] May 7, 2023 -> CLICK"
]
},
{
"website": "marriott",
"id": "4d311ce8-c660-43dc-bde9-d06e85f6a12c",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Book a room for a business meeting from Apr 30 to May 1 with 7 people within 5 miles of New Delhi. The hotel must have a business center and offer high-speed internet, select the nearest hotel.",
"action_reprs": [
"[link] Business Meetings \ue922 -> CLICK",
"[textbox] Destination -> TYPE: new delhi",
"[menuitem] New Delhi, Delhi, India -> CLICK",
"[textbox] Start Date -> CLICK",
"[gridcell] Sat, Apr 29, 2023 -> CLICK",
"[div] 30 -> CLICK",
"[label] Purpose of your event -> CLICK",
"[li] Business -> CLICK",
"[span] -> CLICK",
"[textbox] Guest rooms -> TYPE: 1",
"[textbox] Event space -> TYPE: 7",
"[button] Find -> CLICK",
"[link] \ue602 All Filters -> CLICK",
"[heading] Amenities \ue023 -> CLICK",
"[label] Business center (11) -> CLICK",
"[label] High-speed Internet (11) -> CLICK",
"[button] APPLY -> CLICK",
"[generic] Distance -> CLICK",
"[label] 0 - 5 Miles (2) -> CLICK",
"[button] APPLY -> CLICK",
"[link] ADD TO RFP -> CLICK",
"[link] CREATE RFP -> CLICK"
]
},
{
"website": "kbb",
"id": "efa705c1-f836-4704-b6c8-6e114a2eb865",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Get a service estimate on AC recharge of my 2022 Toyota Corrola, L Sedan 4D. My name is James Smith, email is buckeye.foobar@gmail.com, and phone number is 6157075521.",
"action_reprs": [
"[link] Car Repair -> HOVER",
"[link] Auto Repair Prices -> CLICK",
"[combobox] Year -> SELECT: 2022",
"[combobox] Make -> SELECT: Toyota",
"[combobox] Model -> SELECT: Corolla",
"[combobox] Style -> SELECT: L Sedan 4D",
"[button] Select Vehicle -> CLICK",
"[button] No thanks -> CLICK",
"[textbox] Other Ways We Can Help -> TYPE: ac recharge",
"[button] See Pricing -> CLICK",
"[button] Get Service Estimates -> CLICK",
"[textbox] Your Name * -> TYPE: James Smith",
"[textbox] Email Address * -> TYPE: buckeye.foobar@gmail.com",
"[textbox] Phone Number * -> TYPE: 6157075521",
"[button] Get Estimates -> CLICK"
]
},
{
"website": "united",
"id": "4aaf59c0-889a-406c-b0c2-454d7670e04f",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find the TSA Guidelines to travel with Children",
"action_reprs": [
"[tab] TRAVEL INFO -> CLICK",
"[link] Traveling with children -> CLICK",
"[link] sit on a parent\u2019s lap -> CLICK",
"[link] approved car seat -> CLICK",
"[heading] All other kids -> CLICK"
]
},
{
"website": "kohls",
"id": "8e1a344d-a27b-4613-8863-7afad0829b23",
"domain": "Shopping",
"subdomain": "Department",
"confirmed_task": "Find a cheapest washable blue rug under 2'x3' size.",
"action_reprs": [
"[link] Shop by Category -> CLICK",
"[link] For the Home -> HOVER",
"[link] Rugs -> CLICK",
"[link] Washable Rugs Washable Rugs -> CLICK",
"[span] Color -> CLICK",
"[link] Blue (237) -> CLICK",
"[span] Size -> CLICK",
"[link] Under 2'x3' (38) -> CLICK",
"[link] Sort by: Featured -> CLICK",
"[link] Price Low-High -> CLICK"
]
},
{
"website": "enterprise",
"id": "f7b93dc1-2f19-419e-a6e0-a701008c17fa",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Find the booking with ticket 123456 under the name James Buck.",
"action_reprs": [
"[button] View / Modify / Cancel Reservation -> CLICK",
"[textbox] Confirmation Number (required) -> TYPE: 123456",
"[textbox] First Name (required) -> CLICK",
"[textbox] First Name (required) -> TYPE: James",
"[textbox] Last Name (required) -> TYPE: Buck",
"[button] Search -> CLICK"
]
},
{
"website": "kayak",
"id": "67648411-9d11-4254-8973-7d8dfbca58e8",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "search four door SUVs from Avis while traveling from New Orleans, L, to New York that isn't more than $1000 in total price from Mar 25th to Apr 1st, pickup at 2PM.",
"action_reprs": [
"[link] Search for cars -> CLICK",
"[textbox] Pick-up location -> TYPE: new orleans",
"[span] New Orleans, Louisiana, United States -> CLICK",
"[textbox] Drop-off location -> TYPE: new york",
"[span] New York, United States -> CLICK",
"[generic] Saturday March 25th -> CLICK",
"[button] Saturday March 25, 2023 -> CLICK",
"[generic] Saturday April 1st -> CLICK",
"[button] Saturday April 1, 2023 -> CLICK",
"[button] Noon -> CLICK",
"[option] 2:00 pm -> CLICK",
"[svg] -> CLICK",
"[div] -> CLICK",
"[checkbox] SUV -> CLICK",
"[svg] -> CLICK",
"[div] -> CLICK",
"[checkbox] Avis -> CLICK",
"[button] More filters -> CLICK",
"[checkbox] 4+ doors -> CLICK",
"[spinbutton] Maximum price -> TYPE: 1000",
"[button] Show results -> CLICK"
]
},
{
"website": "kohls",
"id": "0c02c193-2aef-4817-92b4-56722edc6b57",
"domain": "Shopping",
"subdomain": "Department",
"confirmed_task": "I want to see the best seller gender neutral skirts",
"action_reprs": [
"[textbox] Search by keyword or web id -> TYPE: skirt",
"[textbox] Search by keyword or web id -> ENTER",
"[span] Gender -> CLICK",
"[link] Neutral (7) -> CLICK",
"[link] Sort by: Featured -> CLICK",
"[link] Best Sellers -> CLICK"
]
},
{
"website": "viator",
"id": "298c854d-2987-498b-b43e-6a6452fb11c7",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find unique experiences in London of maximum one hour duration which are rated four stars and above",
"action_reprs": [
"[textbox] Where to? -> TYPE: London",
"[button] London England -> CLICK",
"[circle] -> CLICK",
"[link] Unique Experiences -> CLICK",
"[label] Up to 1 hour -> CLICK",
"[label] star-4 -> CLICK"
]
},
{
"website": "gamestop",
"id": "f9062def-8361-48df-849c-4d7dbc1e11d1",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "find trade in value for PS4 console",
"action_reprs": [
"[link] repeat Trade-In -> CLICK",
"[p] Consoles -> CLICK",
"[searchbox] Find values for games and more -> CLICK",
"[searchbox] Find values for games and more -> TYPE: PS4",
"[button] SEARCH -> CLICK",
"[link] Filter -> CLICK",
"[generic] Refine by Category: Consoles & Hardware -> CLICK",
"[link] PlayStation 4 -> CLICK",
"[button] Done -> CLICK"
]
},
{
"website": "apple",
"id": "3b6385ea-0cdc-4ed8-be93-dc90113d2255",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "Find Apple Stores close to zip code 90028",
"action_reprs": [
"[link] Store -> HOVER",
"[link] Find a Store -> CLICK",
"[combobox] Find a store -> TYPE: 90028",
"[option] 90028 Los Angeles, CA, United States -> CLICK"
]
},
{
"website": "apple",
"id": "6c0a3b1e-6ce8-4955-9359-dd4378aacc82",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "Find the price of HomePod mini",
"action_reprs": [
"[link] Accessories -> CLICK",
"[img] -> CLICK",
"[img] -> CLICK"
]
},
{
"website": "apple",
"id": "a10e6232-923d-4635-bdc8-c6d989380e45",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "Add a blue iPad to your cart and select the option for free engraving with \"hello world\" with no other accessaries.",
"action_reprs": [
"[link] iPad -> CLICK",
"[link] Buy iPad 10.9-inch -> CLICK",
"[img] Blue -> CLICK",
"[span] for 12 -> CLICK",
"[div] Every iPad can connect to Wi\u2011Fi, so you can stay c... -> CLICK",
"[radio] Add engraving It won\u2019t impact returns or trade-in ... -> CLICK",
"[textbox] First line -> TYPE: Hello World",
"[button] Save -> CLICK",
"[span] No Apple Pencil -> CLICK",
"[span] No USB-C to Apple Pencil Adapter -> CLICK",
"[span] No keyboard -> CLICK",
"[span] No trade-in -> CLICK",
"[span] Buy -> CLICK",
"[span] No AppleCare+ -> CLICK",
"[button] Add to Bag -> CLICK"
]
},
{
"website": "apple",
"id": "ccee2694-0d3e-4d81-8d52-5cdf82a9b81f",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "Locate the nearest apple store to zip code 60540 and check its opening time tomorrow.",
"action_reprs": [
"[link] Store -> CLICK",
"[link] Find one near you (opens in a new window) \uf301 -> CLICK",
"[combobox] Find a store -> TYPE: 60540",
"[option] 60540 Naperville, IL, United States -> CLICK",
"[address] 120 West Jefferson Avenue -> CLICK"
]
},
{
"website": "qatarairways",
"id": "4786982f-25f5-4bf8-bb91-522656489f63",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Reserve the cheapest hotel with 5 stars and free wifi located in downtown dc in Washington on June 5 for 4 adults in 2 rooms.",
"action_reprs": [
"[button] Book -> CLICK",
"[link] Hotels -> CLICK",
"[searchbox] Please type your destination -> TYPE: washington",
"[option] Washington District of Columbia,\u00a0United States -> CLICK",
"[span] 25 -> CLICK",
"[svg] -> CLICK",
"[svg] -> CLICK",
"[checkbox] 5 June 2023 -> CLICK",
"[div] 1 days -> CLICK",
"[button] Search -> CLICK",
"[button] 2 adults \u00b7 0 children \u00b7 1 room -> CLICK",
"[svg] -> CLICK",
"[svg] -> CLICK",
"[svg] -> CLICK",
"[button] Done -> CLICK",
"[svg] -> CLICK",
"[span] -> CLICK",
"[svg] -> CLICK",
"[span] -> CLICK",
"[span] -> CLICK",
"[link] See availability -> CLICK",
"[button] Reserve -> CLICK"
]
},
{
"website": "instacart",
"id": "bbfed209-df70-434a-aece-5c5fc7a38f4f",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Find the push notification settings",
"action_reprs": [
"[svg] -> CLICK",
"[link] Your account settings -> CLICK",
"[link] Notification settings -> CLICK"
]
},
{
"website": "instacart",
"id": "d0ac6860-23f7-40c1-b30d-12269470d2c3",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "check prices of organic strawberries with three different stores and add the one with lowest price to cart for 94105.",
"action_reprs": [
"[textbox] Search -> CLICK",
"[textbox] Search -> TYPE: organic strawberries",
"[span] organic strawberries -> CLICK",
"[img] Organic Strawberries -> CLICK",
"[span] All stores -> CLICK",
"[textbox] Search -> TYPE: organic strawberries",
"[span] organic strawberries -> CLICK",
"[img] Driscoll's Organic Strawberries -> CLICK",
"[span] All stores -> CLICK",
"[textbox] Search -> TYPE: organic strawberries",
"[span] organic strawberries -> CLICK",
"[img] Organic Strawberries -> CLICK",
"[span] All stores -> CLICK",
"[textbox] Search -> TYPE: organic strawberries",
"[span] organic strawberries -> CLICK",
"[img] Organic Strawberries -> CLICK",
"[img] -> CLICK",
"[button] Add to cart -> CLICK"
]
},
{
"website": "jetblue",
"id": "c73b1674-9c61-46a3-84dd-8fad3622a035",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find the flight from New York to Miami from Mar 27 to Mar 31 that has the lowest core price in points.",
"action_reprs": [
"[textbox] From -> TYPE: new york",
"[strong] New York -> CLICK",
"[textbox] To -> TYPE: miami",
"[strong] Miami -> CLICK",
"[span] 27 -> CLICK",
"[textbox] Return Press DOWN ARROW key to select available da... -> CLICK",
"[span] 31 -> CLICK",
"[span] Search flights -> CLICK",
"[button] Continue to flight results -> CLICK",
"[link] Sort & Filter -> CLICK",
"[svg] -> CLICK",
"[label] Points -> CLICK",
"[link] Sort & Filter -> CLICK",
"[button] Default \u00a0 -> CLICK",
"[span] Price by Core -> CLICK",
"[button] Apply -> CLICK"
]
},
{
"website": "nfl",
"id": "91843d71-05c3-4b17-9b8c-856f2390fe02",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Find the year that Tom Brady had the most touchdowns in a single seasson.",
"action_reprs": [
"[link] Players -> CLICK",
"[link] Tom Brady -> CLICK",
"[link] STATS -> CLICK",
"[link] CAREER -> CLICK",
"[columnheader] TD -> CLICK"
]
},
{
"website": "thetrainline",
"id": "d56df06a-8234-4f31-8737-e74fe9d5fa04",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Get the cheapest return tickets from Leeds to Sheffield leaving at 8:30 am on Mar 25, 2023 and returning at 23:00 pm on same day for 1 adult and 2 child.",
"action_reprs": [
"[combobox] Departure station, none selected. Select a station... -> TYPE: Leeds",
"[span] Leeds -> CLICK",
"[span] Sheffield -> CLICK",
"[textbox] Date use format: 24-Mar-23 -> CLICK",
"[link] 25 -> CLICK",
"[listbox] hour -> SELECT: 08",
"[group] RETURN -> CLICK",
"[link] 25 -> CLICK",
"[listbox] hour -> SELECT: 23",
"[svg] -> CLICK",
"[listbox] select children -> SELECT: 2",
"[listbox] select child age -> SELECT: 5-15",
"[button] Done -> CLICK",
"[button] Get cheapest tickets -> CLICK",
"[button] OK, got it -> CLICK"
]
},
{
"website": "thetrainline",
"id": "daec5481-187d-4e2f-9dae-a11892cdadf2",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Book a journey with return option on same day from Edinburg to Manchester on April 2nd and book the best possible option available.",
"action_reprs": [
"[combobox] Departure station, London selected. -> TYPE: edinburg",
"[span] Edinburgh (Waverley) -> CLICK",
"[combobox] Arrival station, Sheffield selected. -> TYPE: manchester",
"[span] Manchester -> CLICK",
"[radio] Return -> CLICK",
"[textbox] Date use format: 29-Mar-23 -> CLICK",
"[link] 2 -> CLICK",
"[textbox] Date use format: -> CLICK",
"[link] 2 -> CLICK",
"[listbox] hour -> SELECT: 17",
"[button] Get cheapest tickets -> CLICK",
"[span] Continue -> CLICK"
]
},
{
"website": "ryanair",
"id": "4f75897b-8df4-4f4c-88c3-72d440f6a4ee",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Show me all the destinations in Armenia, Austria, Belgium and Bulgaria in Alphabetical order",
"action_reprs": [
"[button] Plan -> CLICK",
"[link] Try Somewhere New -> CLICK",
"[link] Destinations -> CLICK",
"[label] Armenia -> CLICK",
"[label] Austria -> CLICK",
"[label] Belgium -> CLICK",
"[label] Bulgaria -> CLICK",
"[div] Popular -> CLICK",
"[div] A - Z -> CLICK",
"[div] Find destination -> CLICK"
]
},
{
"website": "ryanair",
"id": "555dd7af-72ce-4455-b4d1-dd9b20ae7c5e",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Buy two 100-pound digital gift cards with a birthday card and message of Happy Birthday Love from Stewart Bloom, send to Denise Bloom on email id denise.bloom@bbt.com and Debbie Wolowitz on email id debbie.wo@bbt.com.",
"action_reprs": [
"[img] GIFT CARDS -> CLICK",
"[img] Happy Birthday -> CLICK",
"[button] EUR -> CLICK",
"[div] GBP -> CLICK",
"[button] -> CLICK",
"[div] \u00a3 -> CLICK",
"[div] -> CLICK",
"[textarea] -> TYPE: Happy Birthday Love",
"[input] -> TYPE: Stuart Bloom",
"[input] -> TYPE: Denise",
"[input] -> TYPE: Bloom",
"[input] -> TYPE: denise.bloom@bbt.com",
"[input] -> TYPE: Debbi",
"[input] -> TYPE: Wolowitz",
"[input] -> TYPE: debbi.wo@bbt.com",
"[div] -> CLICK",
"[button] Go to checkout -> CLICK"
]
},
{
"website": "kohls",
"id": "aab91310-0100-4a40-98e9-720c53199bff",
"domain": "Shopping",
"subdomain": "Department",
"confirmed_task": "Find mens hiking shoes under $100 in size 10 that has biggest discount.",
"action_reprs": [
"[textbox] Search by keyword or web id -> TYPE: mens hiking shoes",
"[input] -> CLICK",
"[div] Price -> CLICK",
"[link] $10 to $25 (3) -> CLICK",
"[link] $25 to $50 (18) -> CLICK",
"[link] $50 to $100 (146) -> CLICK",
"[div] Size -> CLICK",
"[link] 10 (131) -> CLICK",
"[link] Sort by: Featured -> CLICK",
"[link] Percent Off -> CLICK",
"[img] Eddie Bauer Canyon Men's Waterproof Hiking Shoes -> CLICK"
]
},
{
"website": "united",
"id": "74b456b6-0e62-429f-b13c-45861f2cdf82",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Search for a recent full-time job in United Airlines corporate in Gurugram, India if a job in sales is available, then apply through email at jacksparrow@gmail.com.",
"action_reprs": [
"[link] Careers -> CLICK",
"[link] Open Jobs -> CLICK",
"[span] -> CLICK",
"[button] Country -> CLICK",
"[span] -> CLICK",
"[button] State / Province -> CLICK",
"[span] -> CLICK",
"[button] City -> CLICK",
"[span] -> CLICK",
"[button] Hiring Type -> CLICK",
"[span] -> CLICK",
"[combobox] Sort by -> SELECT: Most recent",
"[span] Analyst - Sales Programs -> CLICK",
"[button] Apply Now -> CLICK",
"[textbox] Email * is a required field. -> TYPE: jacksparrow@gmail.com",
"[button] Continue -> CLICK"
]
},
{
"website": "united",
"id": "7ec95f61-b8f4-4431-84d2-55d9f7cdd594",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "check flight status for a flight from united airlines leaving Belo Horizonte to Buenos Aires on April 9",
"action_reprs": [
"[tab] TRAVEL INFO -> CLICK",
"[link] Flight status -> CLICK",
"[generic] Apr 7, 2023 -> CLICK",
"[option] Apr 9, 2023 -> CLICK",
"[combobox] Airline. Enter to change collapsed list. Selected ... -> CLICK",
"[option] United Airlines (UA) -> CLICK",
"[combobox] Enter your departing city, airport name, or airpor... -> TYPE: belo horizonte",
"[button] Belo Horizonte, MG, BR (CNF - Tancredo Neves) -> CLICK",
"[combobox] Enter your destination city, airport name, or airp... -> TYPE: buenos aires",
"[button] Buenos Aires, AR (EZE - Ministro Pistarini) -> CLICK",
"[button] Check status -> CLICK"
]
},
{
"website": "united",
"id": "4e9d71b9-b936-41d0-b1f9-cbfc17f79f51",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Calculate the baggage fee for first class flight leaving Columbus CMH to New Orleans MSY on april 9",
"action_reprs": [
"[tab] TRAVEL INFO -> CLICK",
"[link] Baggage info -> CLICK",
"[link] Baggage fee calculator -> CLICK",
"[combobox] From -> TYPE: columbus",
"[button] Columbus, OH, US (CMH) -> CLICK",
"[combobox] To -> TYPE: new orleans",
"[button] New Orleans, LA, US (MSY) -> CLICK",
"[textbox] Depart date -> CLICK",
"[button] Sunday, April 9, 2023 -> CLICK",
"[combobox] CabinTravelers with Economy (first checked bag cha... -> SELECT: Business or First",
"[button] View bag charges -> CLICK"
]
},
{
"website": "united",
"id": "59bdd427-c34b-4b93-a8b8-0c3a49acdcfa",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Book a round-trip flight from Santa Fe, New Mexico to Phoenix, Arizona for 1 adult on August 13th and returning on August 28th.",
"action_reprs": [
"[combobox] Enter your departing city, airport name, or airpor... -> TYPE: Santa Fe",
"[button] Santa Fe, NM, US (SAF) -> CLICK",
"[combobox] Enter your destination city, airport name, or airp... -> TYPE: Phoenix",
"[button] Phoenix, AZ, US (PHX) -> CLICK",
"[textbox] Depart -> CLICK",
"[button] Move forward to switch to the next month. -> CLICK",
"[span] 13 -> CLICK",
"[span] 28 -> CLICK",
"[button] Find flights -> CLICK",
"[button] Roundtrip $681 United Economy (U) Select fare for ... -> CLICK",
"[div] $681 -> CLICK"
]
},
{
"website": "newegg",
"id": "227054d0-24f1-4f8a-9dcb-5146fac623f4",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "Find the cheapest Samsung-made and larger than 11-inch screen Android tablet, in the price range of 200 to 300 dollars and add it to the cart.",
"action_reprs": [
"[link] \ue92e Electronics \uf105 -> CLICK",
"[link] Tablets -> CLICK",
"[img] Samsung -> CLICK",
"[span] 11\" & Larger -> CLICK",
"[button] APPLY -> CLICK",
"[span] 8.7\" -> CLICK",
"[button] APPLY -> CLICK",
"[span] $200 - $300 -> CLICK",
"[button] APPLY -> CLICK",
"[combobox] Featured Items \uf0d7 -> SELECT: Lowest Price",
"[button] ADD TO CART \uf0da -> CLICK"
]
},
{
"website": "ikea",
"id": "813e47ec-6304-42c5-82d4-1fc461247965",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find the cheapest set of stainless steel spoons, which are available in stock in San Diego, California.",
"action_reprs": [
"[link] Products -> CLICK",
"[button] Kitchenware & tableware -> CLICK",
"[link] Flatware & cutlery -> CLICK",
"[span] Columbus -> CLICK",
"[searchbox] Search by ZIP code or city, state -> TYPE: san diego",
"[button] Submit -> CLICK",
"[span] Select store -> CLICK",
"[link] Flatware -> CLICK",
"[button] Show more filters modal -> CLICK",
"[button] Sort Best match -> CLICK",
"[radio] Price: low to high -> CLICK",
"[path] -> CLICK",
"[span] -> CLICK",
"[path] -> CLICK",
"[span] -> CLICK",
"[button] Type -> CLICK",
"[span] -> CLICK",
"[button] Close -> CLICK"
]
},
{
"website": "qatarairways",
"id": "31df4f0d-8852-4694-b6cf-5f337bd26d39",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Retrieve booking 1234567890 booked by Jason Smith",
"action_reprs": [
"[tab] \ue90cMy Trips -> CLICK",
"[textbox] booking reference -> TYPE: 1234567890",
"[textbox] last name -> TYPE: Smith",
"[button] Retrieve booking -> CLICK"
]
},
{
"website": "qatarairways",
"id": "446e3135-8a53-455f-9471-9f6660f6a94d",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Book a best business class flight ticket from Colombo to New York with a two-day Qatar stopover for 2 adults and 1 child on June 24.",
"action_reprs": [
"[textbox] From Autocomplete selection. Enter your place. -> TYPE: colombo",
"[strong] Colombo -> CLICK",
"[textbox] To 2180 results are available, use up and down arr... -> TYPE: new york",
"[strong] New York -> CLICK",
"[textbox] Depart date please enter date in the format dd spa... -> CLICK",
"[gridcell] 24 June 2023 -> CLICK",
"[textbox] Passengers / Class -> CLICK",
"[button] Decrease number of infant passengers -> CLICK",
"[button] Increase number of child passengers -> CLICK",
"[span] (Business/First) -> CLICK",
"[button] Confirm -> CLICK",
"[button] Show flights\ue99a -> CLICK",
"[heading] LKR\u00a01,120,521 -> CLICK",
"[button] Select fare -> CLICK",
"[heading] LKR\u00a03,125,932 -> CLICK",
"[button] Select fare -> CLICK"
]
},
{
"website": "mbta",
"id": "059327ab-e26e-4af6-9063-f58c50ecd2d2",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Show me the schedule and maps for the orange line",
"action_reprs": [
"[link] subway Subway Lines -> CLICK",
"[span] Orange Line -> CLICK",
"[link] Schedules & Maps -> CLICK"
]
},
{
"website": "yellowpages",
"id": "d0d6b0ed-82e4-4ba7-9a9b-7b874dacf19c",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Show me the map of Cleveland's animal shelters.",
"action_reprs": [
"[link] CITY PAGES -> CLICK",
"[link] Cleveland -> CLICK",
"[img] -> CLICK",
"[link] Map View -> CLICK"
]
},
{
"website": "yellowpages",
"id": "e9c7496f-bdea-4651-aeae-0f4d12d59d12",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Filter car accident lawyers in Stanford, CA, sort them by distane and find the phone number of the nearest one.",
"action_reprs": [
"[input] -> TYPE: Stanford, CA",
"[input] -> TYPE: car accident lawyers",
"[link] car accident lawyers -> CLICK",
"[div] Sort: -> CLICK",
"[a] Distance -> CLICK",
"[div] 1. -> CLICK"
]
},
{
"website": "yelp",
"id": "1b310ebc-d9f4-4eb9-b348-30b329207a36",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Find a dry cleaning shop with the highest rating and virtual consultation option for Ironing and stain treatment for a pair of suits and a few delicates in New York City.",
"action_reprs": [
"[link] More -> HOVER",
"[span] Dry Cleaning -> CLICK",
"[textbox] Near -> TYPE: new york city",
"[span] New York, NY -> CLICK",
"[button] Virtual Consultations -> CLICK",
"[button] Recommended -> CLICK",
"[span] Highest Rated -> CLICK",
"[checkbox] Ironing -> CLICK",
"[checkbox] Suits -> CLICK",
"[checkbox] Delicates -> CLICK"
]
},
{
"website": "booking",
"id": "a83c14aa-1a0b-4aaf-a801-ac828d2e81ca",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Find a 4 star rated Hotel in New York Timesquare for 2 adults.",
"action_reprs": [
"[textbox] Where are you going? -> TYPE: Timesqure New York",
"[button] Times Square, New York, NY, USA -> CLICK",
"[button] 1 adult \u00b7 0 children \u00b7 1 room -> CLICK",
"[svg] -> CLICK",
"[button] Done -> CLICK",
"[button] Search -> CLICK",
"[span] -> CLICK",
"[span] -> CLICK",
"[link] Renaissance New York Times Square Hotel Opens in n... -> CLICK"
]
},
{
"website": "carnival",
"id": "a065d3cb-e588-437b-b2e5-38359e770014",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find cruises to Hawaii departing from Los Angeles in January 2024 with a duration of 12 days.",
"action_reprs": [
"[button] SAIL TO -> CLICK",
"[button] Hawaii -> CLICK",
"[button] SAIL FROM -> CLICK",
"[button] Los Angeles, CA -> CLICK",
"[button] DATES -> CLICK",
"[button] January 2024 -> CLICK",
"[button] DURATION -> CLICK",
"[button] 10+ Days -> CLICK",
"[button] SEARCH CRUISES -> CLICK"
]
},
{
"website": "carnival",
"id": "bf159a0f-e6d7-46fa-beea-c231934fa7a9",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find travel agents in Grand Junction, Colorado",
"action_reprs": [
"[button] Search -> CLICK",
"[textbox] Search the site -> TYPE: travel agent",
"[button] Find -> CLICK",
"[link] Find A Travel Agent | Carnival Cruise Line -> CLICK",
"[textbox] City -> TYPE: Grand Junction",
"[combobox] State -> SELECT: Colorado",
"[button] Search -> CLICK"
]
},
{
"website": "carnival",
"id": "bf94a193-a30b-45b7-a93e-4733ea6a7ed4",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find Alaska Cruises from Seattle in September 2023 with a duration of 8 days for 4 people on a ship Carnival Luminosa.",
"action_reprs": [
"[button] SAIL TO -> CLICK",
"[button] Alaska -> CLICK",
"[button] SAIL FROM -> CLICK",
"[button] Seattle, WA -> CLICK",
"[span] Dates -> CLICK",
"[button] September 2023 -> CLICK",
"[button] DURATION -> CLICK",
"[button] 6 - 9 Days -> CLICK",
"[button] SEARCH CRUISES -> CLICK",
"[button] Number of Guests -> CLICK",
"[path] -> CLICK",
"[path] -> CLICK",
"[button] Ships -> CLICK",
"[button] Carnival Luminosa -> CLICK"
]
},
{
"website": "ultimate-guitar",
"id": "1f84888a-bebf-45aa-b8e3-2d9383ff01d3",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Find highest rated chords for the song La Bomba",
"action_reprs": [
"[textbox] Enter artist name or song title -> TYPE: La Bomba",
"[button] SEARCH -> CLICK",
"[link] Chords -> CLICK",
"[link] High rated -> CLICK"
]
},
{
"website": "resy",
"id": "e031c695-28e2-4507-949e-bbb65edf9f3d",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Find an article about a new restaurant and share it on Twitter",
"action_reprs": [
"[link] New Openings -> CLICK",
"[a] -> CLICK",
"[link] \ue906 -> CLICK"
]
},
{
"website": "resy",
"id": "e0ff7945-56b0-487a-920b-cbf954e6fb72",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Reserve a dinner table in the first restaurent in the results, any time after 8 pm tomorrow for two in New York in any available Indian cuisine-serving restaurant.",
"action_reprs": [
"[div] Columbus, OH -> CLICK",
"[button] New York -> CLICK",
"[textbox] Search restaurants, cuisines, etc. -> TYPE: indian",
"[b] Indian -> CLICK",
"[button] Today -> CLICK",
"[button] April 12, 2023. -> CLICK",
"[button] View more availability for BayLeaf Modern Indian C... -> CLICK",
"[button] 8:15 PM Table -> CLICK",
"[button] Reserve Now -> CLICK",
"[button] Done -> CLICK"
]
},
{
"website": "resy",
"id": "ef23fbf3-f05e-41e2-b847-a27028f42470",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Show me \u201cpizza\u201d restaurants near Atlanta",
"action_reprs": [
"[svg] -> CLICK",
"[button] Atlanta -> CLICK",
"[textbox] Search restaurants, cuisines, etc. -> TYPE: pizza",
"[textbox] Search restaurants, cuisines, etc. -> ENTER"
]
},
{
"website": "resy",
"id": "f4bad8a9-72c9-4237-83fa-5673a0e139e9",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Book a table for 2 at a restaurant that was featured on the latest Hit List",
"action_reprs": [
"[link] The Hit List -> CLICK",
"[a] -> CLICK",
"[link] Book Now\ue90b -> CLICK",
"[button] 12:30 PM Outdoor Counter -> CLICK",
"[button] Reserve Now -> CLICK"
]
},
{
"website": "resy",
"id": "f4c21e9f-fbd7-4c45-a282-de06ae3b73c5",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Find a Thai restaurant and get notified when they have an open table between 5 to 7 PM",
"action_reprs": [
"[textbox] Search restaurants, cuisines, etc. -> TYPE: thai",
"[heading] Senyai Thai Kitchen -> CLICK",
"[button] Notify for Dinner -> CLICK",
"[combobox] Preferred end time -> SELECT: 7:00 PM",
"[button] Confirm -> CLICK"
]
},
{
"website": "enterprise",
"id": "22e33a38-902c-4f62-9e9a-822b2370b6d1",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Select the cheapest exotic car for two from Beverly Hills at 11 am on March 31 and return on the same day at 5 pm.",
"action_reprs": [
"[link] Exotic Cars -> CLICK",
"[link] Reserve Now -> CLICK",
"[link] Beverly Hills -> CLICK",
"[button] Selected Pick-Up Date 03/21/2023 -> CLICK",
"[button] 03/31/2023 -> CLICK",
"[combobox] Pick-Up Time Selector -> SELECT: 11:00 AM",
"[button] Date -> CLICK",
"[button] Selected Pick-Up Date 03/31/2023 -> CLICK",
"[combobox] Return Time Selector -> SELECT: 5:00 PM",
"[button] Browse Vehicles -> CLICK",
"[checkbox] 2+ -> CLICK",
"[combobox] SORT BY -> SELECT: Price: Low to High"
]
},
{
"website": "enterprise",
"id": "2cb6558b-3dd7-4acd-a495-a4d3b96369ad",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Browse a list of convertible cars for sale under 20000.",
"action_reprs": [
"[button] Car Sales -> CLICK",
"[link] Shop Vehicles Under $20,000 Link opens in a new wi... -> CLICK",
"[button] Body Type \uf0d7 -> CLICK",
"[path] -> CLICK"
]
},
{
"website": "cvs",
"id": "0fc202d2-4c12-48ca-b04b-b667aac49156",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Browse benadryl items for Allergy Treatments in Liquid form.",
"action_reprs": [
"[combobox] Search products and services -> TYPE: benadryl",
"[button] Search for benadryl -> CLICK",
"[img] -> CLICK",
"[div] -> CLICK",
"[button] Form -> CLICK",
"[div] -> CLICK"
]
},
{
"website": "qatarairways",
"id": "73960473-941b-4e09-8eb1-f059b85c2dba",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Show me the list of one-way flights today (April 17) from Chicago to Paris.",
"action_reprs": [
"[textbox] From Autocomplete selection. Enter your place. -> TYPE: Chicago",
"[menuitem] Chicago United States of America ORD OHare Interna... -> CLICK",
"[textbox] To Autocomplete selection. Enter your place. -> TYPE: Paris",
"[menuitem] Paris France CDG Charles De Gaulle Airport -> CLICK",
"[option] One way -> CLICK",
"[gridcell] 17 April 2023 -> CLICK",
"[button] Continue -> CLICK",
"[button] Show flights\ue99a -> CLICK"
]
},
{
"website": "qatarairways",
"id": "7f1f085b-5765-40f8-86c7-8df6e8b68053",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find information about baggage allowance for business class.",
"action_reprs": [
"[button] Experience -> CLICK",
"[link] Baggage allowance -> CLICK",
"[link] Business Class -> CLICK"
]
},
{
"website": "bookdepository",
"id": "690eedad-706c-4c48-a803-45b4f1c069bb",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Browse bestsellers under $20 and available in hardback.",
"action_reprs": [
"[link] Bestsellers -> CLICK",
"[select] All -> SELECT: Under US$20",
"[select] All -> SELECT: Hardback",
"[button] Refine results -> CLICK"
]
},
{
"website": "bookdepository",
"id": "712d9d7f-d7ee-4554-affa-133449231ae4",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find the latest medical audiobook on complementary medicine for under 20 dollars and add the top book to the cart.",
"action_reprs": [
"[link] Shop by category\u2228 -> HOVER",
"[link] Medical -> CLICK",
"[link] Complementary Medicine -> CLICK",
"[select] All -> SELECT: Audio (376)",
"[select] All -> SELECT: Under US$20",
"[button] Refine results -> CLICK",
"[button] Add to basket -> CLICK"
]
},
{
"website": "bookdepository",
"id": "8e3c7ad0-f138-490e-918e-42bcce9f55a9",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Add a harry potter book to my wishlist.",
"action_reprs": [
"[textbox] Search for books by keyword / title / author / ISB... -> TYPE: Harry Potter",
"[button] Search -> CLICK",
"[link] Harry Potter and the Cursed Child - Parts I & II -> CLICK",
"[link] Add to wishlist -> CLICK",
"[button] Add -> CLICK"
]
},
{
"website": "bookdepository",
"id": "a2b159c8-86d0-4b76-9244-f19cc41d5ad8",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Add a Medical book related to Diseases & Disorders to basket.",
"action_reprs": [
"[link] Shop by category\u2228 -> CLICK",
"[link] Shop by category\u2228 -> CLICK",
"[link] Medical -> CLICK",
"[link] Diseases & Disorders -> CLICK",
"[button] Add to basket -> CLICK"
]
},
{
"website": "kbb",
"id": "4af615be-4472-4357-8737-5286b06b385d",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Browse listings for a used 2006 Honda Civic.",
"action_reprs": [
"[link] Price New/Used -> CLICK",
"[combobox] Year -> SELECT: 2006",
"[combobox] Make -> SELECT: Honda",
"[combobox] Model -> SELECT: Civic",
"[button] Next -> CLICK",
"[link] See Cars for Sale -> CLICK"
]
},
{
"website": "bookdepository",
"id": "31a74ae0-4b8a-407b-8f3d-a094a6966254",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Show books of Dr Seuss with price range of $20 to $40 and add 2 to basket.",
"action_reprs": [
"[link] Shop by category\u2228 -> CLICK",
"[link] Dr. Seuss -> CLICK",
"[select] All -> SELECT: US$20 to US$40",
"[button] Refine results -> CLICK",
"[button] Add to basket -> CLICK",
"[button] Close -> CLICK",
"[button] Add to basket -> CLICK"
]
},
{
"website": "bookdepository",
"id": "4f14fb44-31d8-49f3-b5fb-95826175bcb8",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "search new books from Jk Rowling available for kids within the age from 3 to 5 that are below $20",
"action_reprs": [
"[textbox] Search for books by keyword / title / author / ISB... -> TYPE: Jk rowling",
"[link] Jk rowling -> CLICK",
"[select] Most popular -> SELECT: Publication date, new to old",
"[div] Age range -> CLICK",
"[select] All -> SELECT: Ages 3-5 (31)",
"[select] All -> SELECT: Under US$20",
"[button] Refine results -> CLICK"
]
},
{
"website": "aa",
"id": "0c7a69f9-989d-4899-a3fe-94c952859007",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find flights from Chicago to London on 20 April and return on 23 April.",
"action_reprs": [
"[textbox] From -> TYPE: Chicago",
"[a] CHI - Chicago, IL -> CLICK",
"[textbox] To -> TYPE: London",
"[a] LON - London, United Kingdom -> CLICK",
"[button] \udbf8\udc3a View Calendar: To navigate the calendar, use the... -> CLICK",
"[link] 20 -> CLICK",
"[button] \udbf8\udc3a View Calendar: To navigate the calendar, use the... -> CLICK",
"[link] 23 -> CLICK",
"[button] Search -> CLICK"
]
},
{
"website": "aa",
"id": "0f63c624-6097-473e-ad19-59bc139836d1",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Search for developer jobs in Dallas, Texas, and review details of the latest job then create an 8-day alert after signing in.",
"action_reprs": [
"[link] We're hiring! Join our team , Opens another site i... -> CLICK",
"[button] Careers -> CLICK",
"[link] View All Jobs -> CLICK",
"[textbox] Search by Keyword -> TYPE: developer",
"[textbox] Search by Location -> TYPE: dallas",
"[button] Search Jobs -> CLICK",
"[link] Developer/ Senior Developer, IT -> CLICK",
"[spinbutton] Select how often (in days) to receive an alert: -> TYPE: 8",
"[button] \u2709 Create Alert -> CLICK"
]
},
{
"website": "aa",
"id": "16e81dcf-9762-4b83-be3e-60a65a15efec",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Book a first class vacation travel for 2 adults from San Francisco to New york leavind on april 9 and returning on april 19",
"action_reprs": [
"[span] Vacation packages -> CLICK",
"[textbox] From -> TYPE: san francisco",
"[a] SFO - San Francisco International, CA -> CLICK",
"[textbox] To -> TYPE: new york",
"[a] NYC - New York, NY -> CLICK",
"[combobox] Number of passengers -> SELECT: 2",
"[textbox] Depart (date format mm/dd/yyyy) -> CLICK",
"[button] \udbf8\udc3a View Calendar: To navigate the calendar, use the... -> CLICK",
"[link] 9 -> CLICK",
"[button] \udbf8\udc3a View Calendar: To navigate the calendar, use the... -> CLICK",
"[link] 19 -> CLICK",
"[combobox] Fare preference -> SELECT: First",
"[button] Search , Opens another site in a new window that m... -> CLICK"
]
},
{
"website": "aa",
"id": "26fff471-7083-46e4-945e-d1b167157a0d",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Check refund status for John Davis for ticket no. 1234567890123",
"action_reprs": [
"[link] Receipts and refunds -> CLICK",
"[link] Check the status of a refund -> CLICK",
"[textbox] Ticket number -> CLICK",
"[textbox] Ticket number -> TYPE: 1234567890123",
"[textbox] First name -> CLICK",
"[textbox] First name -> TYPE: John",
"[textbox] Last name -> CLICK",
"[textbox] Last name -> TYPE: Davis",
"[button] Search -> CLICK"
]
},
{
"website": "aa",
"id": "4947d606-626e-4da3-a595-bfedacbed3ec",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Request ticket receipt for ticket no. 1234567890123 and last name Davis",
"action_reprs": [
"[link] Receipts and refunds -> CLICK",
"[link] Receipts for tickets and fees -> CLICK",
"[textbox] Ticket number -> CLICK",
"[textbox] Ticket number -> TYPE: 1234567890123",
"[textbox] Last name -> CLICK",
"[textbox] Last name -> TYPE: Davis",
"[button] Find your receipt -> CLICK"
]
},
{
"website": "ign",
"id": "701bc7ed-4b55-4fd2-b333-128e55c0a4c2",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Find an upcoming game which is releasing in August 2023 for PS5.",
"action_reprs": [
"[button] Toggle Sidebar -> CLICK",
"[button] Discover -> CLICK",
"[link] Upcoming Games -> CLICK",
"[combobox] Platform -> SELECT: PS5",
"[tab] AUG '23 -> CLICK",
"[div] The Texas Chain Saw Massacre -> CLICK"
]
},
{
"website": "ign",
"id": "763deda0-f51c-4520-b102-5277f702e8bd",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Find the initial release date for Guardians of the Galaxy Vol. 3 the movie.",
"action_reprs": [
"[button] Search -> CLICK",
"[searchbox] Search -> TYPE: Guardians of the Galaxy",
"[tab] MOVIES -> CLICK",
"[div] Guardians of the Galaxy Vol. 3 -> CLICK"
]
},
{
"website": "carnival",
"id": "0dc0190c-57cc-4c0f-b939-c0617102166e",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Add to favorites a cruise from San Francisco to the Panama Canal departing Oct 2024",
"action_reprs": [
"[span] Sail To -> CLICK",
"[button] Panama Canal -> CLICK",
"[span] Sail From -> CLICK",
"[button] San Francisco, CA -> CLICK",
"[span] Dates -> CLICK",
"[button] October 2024 -> CLICK",
"[button] SEARCH CRUISES -> CLICK",
"[path] -> CLICK"
]
},
{
"website": "carnival",
"id": "329d9ee8-de96-40c2-aa19-2dcf8e86b724",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Get me info about planning a wedding cruise",
"action_reprs": [
"[link] Weddings & Occasions -> CLICK",
"[heading] DOWNLOAD DIGITAL BROCHURE -> CLICK"
]
},
{
"website": "carnival",
"id": "3b74d9cc-ba1b-441d-a1a2-a05cea62a800",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Browse the trending daily deals.",
"action_reprs": [
"[link] Today's Deals -> CLICK",
"[link] Trending (2) -> CLICK"
]
},
{
"website": "carnival",
"id": "4008118a-68a1-4a9f-968c-8b92a979dff7",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Show me the breakfast options on the Carnival Breeze ship.",
"action_reprs": [
"[button] Explore -> HOVER",
"[link] Dining -> CLICK",
"[span] EXPLORE DINING -> CLICK",
"[radio] Filter group Ship: Carnival Breeze -> CLICK",
"[radio] Filter group Meal Time: Breakfast -> CLICK"
]
},
{
"website": "rottentomatoes",
"id": "f86b0a14-ed91-491d-85be-b0af0b849353",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Browse movies in theaters that are certified fresh and sorty by highest audience score.",
"action_reprs": [
"[link] MOVIES -> CLICK",
"[svg] -> CLICK",
"[div] -> CLICK",
"[button] APPLY -> CLICK",
"[svg] -> CLICK",
"[div] -> CLICK"
]
},
{
"website": "marriott",
"id": "e48f848d-62b8-441e-aafb-c76aeb2c4f84",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Look for an internship role for a university graduated in the in Germany, and apply to the job posted in last 7 days.",
"action_reprs": [
"[button] Our Company\ue91e -> CLICK",
"[link] Careers \ue922 -> CLICK",
"[link] Students & Grads -> CLICK",
"[link] INTERNSHIP PROGRAMS -> CLICK",
"[link] HOTEL INTERNSHIPS INTERNATIONAL -> CLICK",
"[button] Locations -> CLICK",
"[button] Germany -> CLICK",
"[button] Posting Dates -> CLICK",
"[button] Less than 7 days -> CLICK",
"[span] Voyage Program, European Union Member States -> CLICK",
"[button] APPLY NOW -> CLICK"
]
},
{
"website": "soundcloud",
"id": "d4f9c67f-00c5-41ed-bde1-c704b92647f7",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Compare Pro Plans with other plans available.",
"action_reprs": [
"[link] Try Next Pro -> CLICK",
"[button] Compare plans -> CLICK"
]
},
{
"website": "soundcloud",
"id": "efe9051b-d626-443c-b8c8-e7844a0acd29",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Find popular tracks from the rock band Nirvana.",
"action_reprs": [
"[searchbox] Search -> TYPE: Nirvana",
"[link] Search for \u201cNirvana\u201d -> CLICK",
"[link] Nirvana -> CLICK",
"[link] Popular tracks -> CLICK"
]
},
{
"website": "parking",
"id": "aa1a4414-f141-42b8-9e8b-28d5bd1eeef2",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find parking near Venice Beach that allows mobile coupons.",
"action_reprs": [
"[combobox] \uf002\u00a0 Enter an Address or Venue to find parking -> TYPE: Venice Beach",
"[em] Venice -> CLICK",
"[strong] Filters -> CLICK",
"[checkbox] \uf145Accepts Mobile Coupons -> CLICK"
]
},
{
"website": "parking",
"id": "b1fa9bb3-6e2c-485b-90f1-2a54510bf358",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find parking near Disneyland that has EV charging.",
"action_reprs": [
"[span] Enter an Address or Venue to find parking -> TYPE: Disneyland",
"[combobox] \uf002\u00a0 Enter an Address or Venue to find parking -> ENTER",
"[strong] Filters -> CLICK",
"[checkbox] \uf0e7EV Charging -> CLICK",
"[link] View Details (P) SPHERE ON DEMAND - CITY OF ANAHEI... -> CLICK"
]
},
{
"website": "parking",
"id": "b9f5dd60-690d-4f32-9e69-3db9d346f020",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find out what payment methods are available for monthly parking.",
"action_reprs": [
"[link] SUPPORT -> CLICK",
"[heading] What forms of payment do you accept for monthly pa... -> CLICK"
]
},
{
"website": "parking",
"id": "cdb6b70d-6083-49b5-908c-a6c0f711c175",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find parking spaces near Warner Theatre in Washington DC.",
"action_reprs": [
"[link] CITIES -> CLICK",
"[heading] WASHINGTON DC -> CLICK",
"[link] Theaters -> CLICK",
"[link] Warner Theatre Theaters -> CLICK",
"[link] SEE OPTIONS -> CLICK",
"[heading] The Portals Parking -> CLICK"
]
},
{
"website": "parking",
"id": "fbefeb82-f3e6-4db4-acc6-a68b1d519ba7",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Add a parking button code for my company Boston Legal located near Boston Navy Yard, and the button should be 160x400 pixels, and the parking spot should be within 15 miles of my address.",
"action_reprs": [
"[link] ADD PARKING TO YOUR WEBSITE -> CLICK",
"[textbox] STEP 1: Enter Your Company Name -> TYPE: BOSTON LEGAL",
"[combobox] STEP 2:Enter an address to search and select a loc... -> TYPE: BOSTON NAVY YARD",
"[em] Navy -> CLICK",
"[span] 300 pixels x 150 pixels -> CLICK",
"[span] 160 pixels x 400 pixels -> CLICK",
"[span] Default -> CLICK",
"[li] .15 miles -> CLICK",
"[link] Get My Code -> CLICK"
]
},
{
"website": "ryanair",
"id": "725c38e7-7987-40b3-8f19-8450f8277f06",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find the cheapest event to attend in Athens, Greece on April 2nd",
"action_reprs": [
"[div] Events & Activities -> CLICK",
"[input] -> CLICK",
"[button] Greece -> CLICK",
"[button] Athens -> CLICK",
"[button] Go! -> CLICK",
"[div] Sort by -> CLICK",
"[div] Lowest price -> CLICK",
"[div] All dates -> CLICK",
"[span] 2 -> CLICK",
"[span] 2 -> CLICK",
"[generic] Athens Piraeus and Glyfada Hop on Hop off Tour -> CLICK"
]
},
{
"website": "ryanair",
"id": "767faaa6-220e-4e6c-ac1d-39b1501c69cf",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Hire a large car with air conditioning for a small group to pick up from Berlin on May 15, 11:30 am, and drop off at the exact location on May 16, 11 am, book with full protection and payment with a credit card.",
"action_reprs": [
"[div] Car Hire -> CLICK",
"[textbox] I need a car in -> TYPE: berlin",
"[button] Berlin Berlin Federal State, Germany (City) -> CLICK",
"[div] -> CLICK",
"[generic] 15 -> CLICK",
"[generic] 16 -> CLICK",
"[button] 11:30 -> CLICK",
"[button] 11:00 -> CLICK",
"[button] Let's go -> CLICK",
"[link] Large cars 5\u00a0Seats 3 Large bags -> CLICK",
"[ins] -> CLICK",
"[ins] -> CLICK",
"[ins] -> CLICK",
"[link] Show all 10 cars -> CLICK",
"[link] Opel Insignia\u00a0or Similar , View deal -> CLICK",
"[radio] Radio yes -> CLICK",
"[link] Go to book -> CLICK"
]
},
{
"website": "instacart",
"id": "844f8d77-e12e-4d68-8c4c-9146bd5b1530",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Open gift list for beauty products.",
"action_reprs": [
"[path] -> CLICK",
"[button] More ways to shop -> CLICK",
"[link] Send gifts -> CLICK",
"[span] Beauty -> CLICK"
]
},
{
"website": "instacart",
"id": "8f6374b0-36f1-478e-a282-a61849c8174f",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Add eleven produce items from Aldi, including 1 pack of blueberry, 6 bananas, 1 grape tomato, 1 roma tomato, 1 cilantro, to my cart and have it delivered tomorrow between 10am and 1pm to the default address.",
"action_reprs": [
"[img] -> CLICK",
"[link] Produce -> CLICK",
"[link] Fresh Fruits -> CLICK",
"[span] Add -> CLICK",
"[span] Add -> CLICK",
"[path] -> CLICK",
"[link] Fresh Vegetables -> CLICK",
"[span] Add -> CLICK",
"[span] Add -> CLICK",
"[link] Herbs -> CLICK",
"[div] Add -> CLICK",
"[button] View Cart. Items in cart: 5 -> CLICK",
"[button] View Cart. Items in cart: 5 -> CLICK",
"[div] Go to checkout -> CLICK",
"[div] -> CLICK",
"[button] Confirm address -> CLICK",
"[p] Choose 3-hour window -> CLICK",
"[div] 10am - 1pm -> CLICK",
"[button] Save -> CLICK"
]
},
{
"website": "instacart",
"id": "945ac29d-8e65-4e14-8bab-21742ac92a47",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Find the cheapest bananas at Kroger",
"action_reprs": [
"[img] -> CLICK",
"[textbox] Search Kroger... -> TYPE: bananas",
"[span] bananas -> CLICK",
"[span] Best match -> CLICK",
"[option] Price: lowest first -> CLICK"
]
},
{
"website": "instacart",
"id": "96fb7e5d-08b1-4def-a6f8-6ee81055d944",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Search for Gingerbread cakes recipe and add ingredients to cart.",
"action_reprs": [
"[textbox] Search -> TYPE: Gingerbread cakes",
"[link] gingerbread cakes -> CLICK",
"[button] Recipes -> CLICK",
"[img] -> CLICK",
"[button] Add 3 items to cart -> CLICK"
]
},
{
"website": "yelp",
"id": "f408cdf3-06c8-459c-ba08-71bd471341a0",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Find places that serve burgers in 44012 zip code and sort the results by highest rated",
"action_reprs": [
"[textbox] Find -> CLICK",
"[textbox] Find -> TYPE: Burgers",
"[span] Burgers -> CLICK",
"[textbox] Near -> CLICK",
"[textbox] Near -> TYPE: 44012",
"[button] Search -> CLICK",
"[button] Recommended -> CLICK",
"[span] Highest Rated -> CLICK"
]
},
{
"website": "sports.yahoo",
"id": "96c35c7a-a0d6-42c3-9814-eb2698c802a4",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Open the news page with the UFC schedule.",
"action_reprs": [
"[link] MMA . -> HOVER",
"[link] UFC Schedule . -> CLICK"
]
},
{
"website": "sports.yahoo",
"id": "9a462751-758e-42bd-967d-373c13b90382",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Find the current injuries of Phoenix Suns players.",
"action_reprs": [
"[link] NBA . -> HOVER",
"[div] Phoenix -> CLICK",
"[link] Injuries -> CLICK"
]
},
{
"website": "sports.yahoo",
"id": "9b03e9a1-39bb-48d5-a33a-a2b05a6eb379",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Search for upcoming MLB games taking place on Sunday, 3/19.",
"action_reprs": [
"[link] MLB . -> CLICK",
"[link] Scores/Schedules -> CLICK",
"[link] Next day -> CLICK",
"[link] Next day -> CLICK"
]
},
{
"website": "sports.yahoo",
"id": "9f57055d-c269-47d7-99be-3525d725439e",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "Find the NBA team with the best odds to win the NBA title.",
"action_reprs": [
"[link] NBA . -> HOVER",
"[link] Odds . -> CLICK",
"[button] Futures -> CLICK"
]
},
{
"website": "ikea",
"id": "6b4aa5a9-79c5-49a3-9cc6-ead02159a3dd",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find a Queen size memory foam mattress with lowest price.",
"action_reprs": [
"[button] Menu -> CLICK",
"[button] Products -> CLICK",
"[button] Beds & mattresses -> CLICK",
"[link] Mattresses -> CLICK",
"[img] Foam and memory foam mattresses -> CLICK",
"[button] Show sorting options modal -> CLICK",
"[span] Price: low to high -> CLICK",
"[button] Show filter modal size -> CLICK",
"[span] -> CLICK",
"[img] -> CLICK"
]
},
{
"website": "ikea",
"id": "6ca55141-9ba6-4ed7-8c07-77df6c24029d",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find the lowest-priced gray-colored round-shaped mirror in stock in Atlanta, Georgia, with a maximum price of 20 dollars.",
"action_reprs": [
"[combobox] Search by product -> TYPE: mirror",
"[button] Search -> CLICK",
"[span] Columbus -> CLICK",
"[searchbox] Search by ZIP code or city, state -> TYPE: atlanta georgia",
"[button] Submit -> CLICK",
"[span] Select store -> CLICK",
"[button] Show more filters modal -> CLICK",
"[button] Sort Best match -> CLICK",
"[radio] Price: low to high -> CLICK",
"[button] Sort -> CLICK",
"[button] Shape -> CLICK",
"[span] -> CLICK",
"[button] Shape -> CLICK",
"[span] -> CLICK",
"[button] Price -> CLICK",
"[span] -> CLICK",
"[button] Close -> CLICK"
]
},
{
"website": "underarmour",
"id": "6e98e331-c80b-4316-b332-af76c4cb2440",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Search for women's golf polos in m size, priced between 50 to 75 dollars, and save the lowest priced among results.",
"action_reprs": [
"[menuitem] Women -> HOVER",
"[menuitem] Golf -> CLICK",
"[div] Product Category -> CLICK",
"[link] Clothing -> CLICK",
"[div] Product Type -> CLICK",
"[link] Polos -> CLICK",
"[div] Size -> CLICK",
"[link] M -> CLICK",
"[span] Now Trending -> CLICK",
"[li] Price (Low - High) -> CLICK",
"[button] Add to Wish List -> CLICK"
]
},
{
"website": "tvguide",
"id": "6f4e562e-91f9-401d-8730-af947985b821",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Add 3 most rated to watch tv shows or movies on Amazon Prime to watchlist.",
"action_reprs": [
"[link] What to Watch on Amazon Prime -> CLICK",
"[button] Filter -> CLICK",
"[button] Highest Rated -> CLICK",
"[button] View Results -> CLICK",
"[span] Watchlist -> CLICK",
"[span] Watchlist -> CLICK",
"[span] Watchlist -> CLICK"
]
},
{
"website": "tvguide",
"id": "789b7d2d-fb01-453c-b933-383965e6123c",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Find cast and crew of Titanic and add to watchlist",
"action_reprs": [
"[textbox] Search TV Shows and Movies... -> TYPE: Titanic",
"[div] Titanic -> CLICK",
"[link] Cast & Crew -> CLICK",
"[span] Watchlist -> CLICK"
]
},
{
"website": "enterprise",
"id": "d5054276-2223-44f3-b2ed-4944bae4d2b1",
"domain": "Travel",
"subdomain": "Car rental",
"confirmed_task": "Find a Hotel in Boston zip code 02199 and make a pick-up reservation in a suv with gps for 2 people on March 27 11 am and return on March 29, 1 pm.",
"action_reprs": [
"[button] Locations -> CLICK",
"[link] United States Car Rental Locations -> CLICK",
"[searchbox] Location (required) * Required Field -> TYPE: 02199",
"[span] 02199 -> CLICK",
"[button] Continue -> CLICK",
"[button] All Location Details -> CLICK",
"[button] Selected Pick-Up Date 03/23/2023 -> CLICK",
"[button] 03/27/2023 -> CLICK",
"[combobox] Pick-Up Time Selector -> SELECT: 11:00 AM",
"[button] Date -> CLICK",
"[button] 03/29/2023 -> CLICK",
"[combobox] Return Time Selector -> SELECT: 1:00 PM",
"[button] Browse Vehicles -> CLICK",
"[checkbox] SUVs -> CLICK",
"[checkbox] 2+ -> CLICK",
"[button] Select Nissan Kicks Vehicle -> CLICK",
"[button] Add -> CLICK",
"[button] Continue to Review -> CLICK"
]
},
{
"website": "viator",
"id": "8308d10f-3904-473a-a186-c6b8f939f018",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find the longest private sightseeing trip of India in the month of June",
"action_reprs": [
"[textbox] Where to? -> TYPE: India",
"[button] India Asia -> CLICK",
"[button] Next -> CLICK",
"[path] -> CLICK",
"[gridcell] Thu Jun 01 2023 -> CLICK",
"[gridcell] Fri Jun 30 2023 -> CLICK",
"[button] Apply -> CLICK",
"[circle] -> CLICK",
"[button] -> CLICK",
"[div] Sightseeing Tours -> CLICK",
"[label] Private Tour -> CLICK",
"[span] Featured -> CLICK",
"[span] Duration (Long to Short) -> CLICK"
]
},
{
"website": "ikea",
"id": "479bdc82-ec52-447b-a577-fa2bcdc3886f",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Show offers on home essentials under $20 and add the first 3 items to favorites.",
"action_reprs": [
"[link] Deals -> CLICK",
"[link] Home Essentials Under $20 -> CLICK",
"[button] Save to favorites, KUDDARNA, Chair pad, outdoor -> CLICK",
"[button] Save to favorites, GULLBERGS\u00d6, Cushion cover, in/o... -> CLICK",
"[button] Save to favorites, FEJAN, Chair, outdoor -> CLICK"
]
},
{
"website": "ikea",
"id": "577ac962-aefc-46c5-9050-a6069bf2a8fb",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find spare parts with part number 105307 and add 2 of them to cart.",
"action_reprs": [
"[button] Menu -> CLICK",
"[link] Customer Service -> CLICK",
"[div] Need an extra part? -> CLICK",
"[link] Read more -> CLICK",
"[span] Order spare parts -> CLICK",
"[input] -> TYPE: 105307",
"[button] 105307 -> CLICK",
"[combobox] Change quantity -> SELECT: 2",
"[span] Add to cart -> CLICK"
]
},
{
"website": "ikea",
"id": "60383804-a8e5-4e50-8715-da391d76617d",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Browse candle holder red decor products.",
"action_reprs": [
"[link] Marketplace -> CLICK",
"[link] Shop by Color -> CLICK",
"[link] Shop red -> CLICK",
"[button] Show filter modal Category -> CLICK",
"[span] -> CLICK"
]
},
{
"website": "ikea",
"id": "618dbd1f-16e6-442e-ba3b-364c6dbda810",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Go to limited-time offers and choose the cheapest outdoor dining table, add to the cart, and checkout as a guest and select Ikea West Chester store for pick-up.",
"action_reprs": [
"[link] Deals -> CLICK",
"[link] Limited Time Offers -> CLICK",
"[button] Show filter modal Category -> CLICK",
"[button] Furniture 356 -> CLICK",
"[button] + 11 more -> CLICK",
"[button] Furniture sets 138 -> CLICK",
"[button] Outdoor dining sets 46 -> CLICK",
"[button] Add to bag, T\u00c4RN\u00d6, Table+2 chairs, outdoor -> CLICK",
"[link] Shopping bag, 1 items -> CLICK",
"[span] Continue to checkout -> CLICK",
"[span] Guest checkout -> CLICK",
"[span] Select a store -> CLICK",
"[span] IKEA West Chester -> CLICK",
"[button] Close -> CLICK"
]
},
{
"website": "seatgeek",
"id": "e93fe82b-c3ed-4661-92f6-ea0abb1b2b63",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Browse the page to find classic rock concert tickets.",
"action_reprs": [
"[link] Music -> HOVER",
"[a] Genres -> HOVER",
"[link] Classic Rock -> CLICK"
]
},
{
"website": "seatgeek",
"id": "fbaa5c83-11ed-40d8-b5e6-d4ddb9a1cbde",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Search for comedy shows taking place in Chicago, IL and expand the results once.",
"action_reprs": [
"[button] Change Location -> CLICK",
"[searchbox] Search by city... -> TYPE: Chicago",
"[option] Chicago, IL -> CLICK",
"[button] See next Categories -> CLICK",
"[img] Comedy -> CLICK",
"[span] View more -> CLICK"
]
},
{
"website": "aa",
"id": "c175fe34-143b-4a87-a462-e8e9d69d0b95",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Check flight status from London to New York City for next day.",
"action_reprs": [
"[link] Flight status -> CLICK",
"[textbox] From , required. -> TYPE: London",
"[a] LON - London, United Kingdom -> CLICK",
"[textbox] To , required. -> TYPE: New York",
"[a] NYC - New York, NY -> CLICK",
"[combobox] Date -> SELECT: Friday, April 7",
"[button] Search -> CLICK",
"[link] Check status\u00a0\u00bb for flight, 6930 of American Airlin... -> CLICK"
]
},
{
"website": "aa",
"id": "f804150b-c2e9-40ca-b71f-d0d0d95e0c46",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find the cheapest hotel in New York City for 2 adults from Apr7 to Apr 8.",
"action_reprs": [
"[link] Hotel , Opens another site in a new window that ma... -> CLICK",
"[searchbox] Type your destination -> TYPE: New York City",
"[option] New York\u00a0(New York City) New York State,\u00a0United St... -> CLICK",
"[checkbox] 7 April 2023 -> CLICK",
"[checkbox] 8 April 2023 -> CLICK",
"[button] Search -> CLICK",
"[menuitem] Price (lowest first) -> CLICK",
"[link] Millennium Hilton New York One UN Plaza -> CLICK"
]
},
{
"website": "ryanair",
"id": "edf748d4-07cd-4f0b-aad3-01baebbd557b",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Book the cheapest available hotel for a three night stay from 1st June in Jakarta. The guest is named Joe Bloggs with the email address of buckeye.foobar@gmail.com and phone number of 11111111111. Billing address is in New York, zip code 10001\n.",
"action_reprs": [
"[button] hotels -> CLICK",
"[div] Destination or property -> TYPE: jakarta",
"[hp-input-button] Destination or property -> TYPE: jakarta",
"[div] Jakarta, Special Capital Region of Jakarta -> CLICK",
"[div] Choose date -> CLICK",
"[div] Jun -> CLICK",
"[generic] 1 -> CLICK",
"[generic] 4 -> CLICK",
"[button] Search -> CLICK",
"[button] Yes, I agree -> CLICK",
"[span] Lowest price -> CLICK",
"[button] Choose room -> CLICK",
"[button] Book now -> CLICK",
"[textbox] First name -> TYPE: Joe",
"[textbox] Surname -> TYPE: Bloggs",
"[textbox] Email address -> TYPE: buckeye.foobar@gmail.com",
"[textbox] Confirm email address -> TYPE: buckeye.foobar@gmail.com",
"[input] -> TYPE: 1111111111111111",
"[textbox] Address 1 -> TYPE: the home of joe bloggs",
"[textbox] City -> TYPE: new york",
"[textbox] Postcode/ZIP code -> TYPE: 10001",
"[combobox] State -> TYPE: new york",
"[textbox] Card number -> TYPE: 1234",
"[combobox] Card type -> SELECT: MasterCard",
"[combobox] Month -> SELECT: 01",
"[combobox] Year -> SELECT: 2023",
"[textbox] CVV -> TYPE: 123",
"[textbox] Cardholder's name -> TYPE: joe bloggs",
"[svg] -> CLICK"
]
},
{
"website": "amtrak",
"id": "41cd71cb-cae5-41c8-abe8-67e42fabd4a5",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find the details of Grand National Parks tour.",
"action_reprs": [
"[button] DEALS -> CLICK",
"[link] VACATIONS & RAIL TOURS Train vacation packages thr... -> CLICK",
"[img] -> CLICK",
"[link] Close -> CLICK",
"[button] Itinerary -> CLICK",
"[button] Details -> CLICK"
]
},
{
"website": "amtrak",
"id": "4498c83b-029f-4f1e-af81-722de20160e2",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find a train with the shortest trip from New York, NY to Washington DC on June 1 in first class and add the ticket to the cart, preferably in the morning .",
"action_reprs": [
"[textbox] From -> TYPE: new york",
"[option] New York, NY - Moynihan Train Hall at Penn Sta. (N... -> CLICK",
"[textbox] To -> TYPE: washington",
"[option] Washington, DC - Union Station (WAS) -> CLICK",
"[div] Depart Date -> CLICK",
"[button] Next month -> CLICK",
"[gridcell] Thursday, June 1, 2023 -> CLICK",
"[button] Done -> CLICK",
"[button] FIND TRAINS -> CLICK",
"[span] Sort/Filter -> CLICK",
"[checkbox] filter trains by Time of Day:6a-12p -> CLICK",
"[mat-pseudo-checkbox] -> CLICK",
"[button] Close -> CLICK",
"[button] First from $722 -> CLICK",
"[button] ADD TO CART -> CLICK"
]
},
{
"website": "nps.gov",
"id": "bef473f1-82a1-4359-a2c0-59b6dc2f6abb",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find a park in Alaska that is also a National Heritage Area.",
"action_reprs": [
"[button] Find a Park by State -> CLICK",
"[link] Alaska -> CLICK",
"[link] 1 National Heritage Area \u00bb -> CLICK",
"[link] Kenai Mountains-Turnagain Arm National Heritage Ar... -> CLICK"
]
},
{
"website": "nps.gov",
"id": "c2a17420-ceb4-4324-ae8f-60cf845a144b",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Open Canyon de Chelly schedule calendar.",
"action_reprs": [
"[link] FIND A PARK -> CLICK",
"[combobox] Park Name -> TYPE: Canyon de Chelly",
"[option] Canyon de Chelly National Monument -> CLICK",
"[link] CALENDAR -> CLICK"
]
},
{
"website": "nps.gov",
"id": "f863168b-1d7e-4f51-9681-79891abc4b45",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find a park in the National Park System that has a Junior Ranger Program for kids.",
"action_reprs": [
"[link] FIND A PARK -> CLICK",
"[link] Search by Activity or Topic -> CLICK",
"[button] Activity -> CLICK",
"[input] -> CLICK",
"[button] Search -> CLICK"
]
},
{
"website": "nyc",
"id": "196cde81-b001-47ec-b7c3-a77869e36deb",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "check bookstores available in Chelsea area",
"action_reprs": [
"[link] shopping. -> CLICK",
"[li] Neighborhood -> CLICK",
"[link] Chelsea -> CLICK",
"[link] Bookstore (3) -> CLICK"
]
},
{
"website": "nyc",
"id": "1a807a1c-d3b2-425e-9684-2a9e79846676",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "search for restaurant that offers African Cuisine in east village under $30",
"action_reprs": [
"[link] restaurants. -> CLICK",
"[li] Cuisine -> CLICK",
"[link] African -> CLICK",
"[link] East Village (2) -> CLICK",
"[link] $16 To $30 (2) -> CLICK"
]
},
{
"website": "nyc",
"id": "1cc13b4e-d3d3-480f-a2fe-f18e83159d93",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "with a $200 budget check available in central parkto check in on 24th to 27th march for 2 adult and a toddler less than a year old.",
"action_reprs": [
"[link] hotels. -> CLICK",
"[textbox] Check In \uf073 -> CLICK",
"[link] 24 -> CLICK",
"[textbox] Sun Mar 26 \uf073 -> CLICK",
"[link] 27 -> CLICK",
"[combobox] \uf0d7 -> SELECT: 1 Room",
"[combobox] \uf0d7 -> SELECT: 2 Adults",
"[combobox] \uf0d7 -> SELECT: 1 Child",
"[select] Age -> SELECT: 0",
"[link] Search Hotels -> CLICK",
"[radio] $100 to $200 -> CLICK",
"[radio] New York (and vicinity) -> CLICK",
"[radio] Central Park -> CLICK"
]
},
{
"website": "kayak",
"id": "26d3a803-b0aa-4a2c-bd31-3fe97a63388c",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find vacation packages to Hawaii.",
"action_reprs": [
"[link] Search for packages -> CLICK",
"[link] Hawaii Vacations -> CLICK",
"[button] Search packages -> CLICK"
]
},
{
"website": "kayak",
"id": "38fe67f7-14af-4259-8309-aa350abdc395",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Search for the cheapest two rooms near Kashi Vishwanath Temple in India for three adults and a 7-year-old kid from June 6 to 10 in any 3-star and up air-conditioned family hotel with a review score of at least 8, free internet.",
"action_reprs": [
"[link] Search for hotels -> CLICK",
"[textbox] Enter a city, hotel, airport, address or landmark -> TYPE: kashi vishwanath temple",
"[span] Kashi Vishwanath Temple, Varanasi, Uttar Pradesh, ... -> CLICK",
"[path] -> CLICK",
"[div] 6 -> CLICK",
"[div] 10 -> CLICK",
"[button] Increment -> CLICK",
"[button] Increment -> CLICK",
"[button] Increment -> CLICK",
"[span] 0 -> TYPE: 7",
"[tab] 7 -> CLICK",
"[path] -> CLICK",
"[div] 8+ -> CLICK",
"[div] 3 -> CLICK",
"[checkbox] Free internet -> CLICK",
"[button] Style -> CLICK",
"[checkbox] Family -> CLICK",
"[button] Amenities -> CLICK",
"[checkbox] Air-conditioned -> CLICK",
"[div] Distance -> CLICK",
"[tab] Price (low to high) -> CLICK"
]
},
{
"website": "flightaware",
"id": "0991035b-6acb-4dca-aaef-5384a0739781",
"domain": "Travel",
"subdomain": "Other",
"confirmed_task": "Find careers at the company on the Product Management team",
"action_reprs": [
"[link] Company -> CLICK",
"[link] Career Opportunities -> CLICK",
"[select] All teams -> SELECT: Product Management"
]
},
{
"website": "store.steampowered",
"id": "05238c0f-514f-4af2-bc4c-f7521d649825",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Find Dota 2 game and add all DLC to cart.",
"action_reprs": [
"[textbox] search -> CLICK",
"[textbox] search -> TYPE: Dota 2",
"[link] Dota 2 Free -> CLICK",
"[link] Add all DLC to Cart -> HOVER"
]
},
{
"website": "jetblue",
"id": "5c52af02-ccc7-491a-bea7-05de278bf7da",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find the cheapest flight from any New York airport to Aruba for 1 person using TrueBlue points which leaves on May 1 and returns on May 5",
"action_reprs": [
"[textbox] From -> TYPE: New York",
"[option] New York City area (NYC) -> CLICK",
"[textbox] To -> TYPE: Aruba",
"[option] Aruba (AUA) -> CLICK",
"[span] 1 -> CLICK",
"[button] return Friday, May 5, 2023 -> CLICK",
"[span] -> CLICK",
"[span] Search flights -> CLICK",
"[link] Sort & Filter -> CLICK",
"[button] Default \u00a0 -> CLICK",
"[span] Price (low to high) -> CLICK",
"[button] Apply -> CLICK"
]
},
{
"website": "qatarairways",
"id": "ff82e848-f29e-477b-a286-c807cbd0d8fa",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Search for a job in customer services in Qatar Airways, find any job available in India, view the details and save the job.",
"action_reprs": [
"[link] Careers This link will take you away from the Qata... -> CLICK",
"[span] 64 -> CLICK",
"[textbox] Location -> TYPE: india",
"[link] Mumbai - BOM, India - IN 2 jobs -> CLICK",
"[button] Search -> CLICK",
"[span] -> CLICK",
"[span] Customer Experience- Customer Services Agent (Cont... -> CLICK",
"[checkbox] Save Customer Experience- Customer Services Agent ... -> CLICK"
]
},
{
"website": "discogs",
"id": "ec472065-2913-40df-bbbf-ee95bc76485a",
"domain": "Entertainment",
"subdomain": "Music",
"confirmed_task": "Create a new list named New that includes thr\nee albums, one each from the genres pop, rock and electronic.",
"action_reprs": [
"[button] Explore -> CLICK",
"[link] Rock -> CLICK",
"[img] David Bowie -> CLICK",
"[link] David Bowie -> CLICK",
"[button] Add to List -> CLICK",
"[radio] New List -> CLICK",
"[textbox] Title -> TYPE: New",
"[button] Save -> CLICK",
"[button] Explore -> CLICK",
"[link] Electronic -> CLICK",
"[img] Madonna -> CLICK",
"[link] Like A Virgin -> CLICK",
"[button] Add to List -> CLICK",
"[combobox] List -> SELECT: New",
"[button] Save -> CLICK",
"[button] Explore -> CLICK",
"[link] Explore All -> CLICK",
"[link] 3,682,991 Pop -> CLICK",
"[img] Phil Collins - No Jacket Required -> CLICK",
"[button] Add to List -> CLICK",
"[combobox] List -> SELECT: New",
"[button] Save -> CLICK",
"[button] Explore -> CLICK",
"[link] List Explorer -> CLICK",
"[link] Manage My Lists -> CLICK",
"[link] New -> CLICK"
]
},
{
"website": "newegg",
"id": "effb9df8-3b3f-4349-8033-f79ba1587a4d",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "Find a projector which accepts crypto currency as payment.",
"action_reprs": [
"[searchbox] Search Site -> TYPE: projectors",
"[button] \uf002 -> CLICK",
"[label] ON -> CLICK"
]
},
{
"website": "rei",
"id": "8aae9804-0765-4e14-ab71-4dc13ada32f7",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find camping tents that can fit 6 people and sort the results by price from low to high.",
"action_reprs": [
"[button] Camp & Hike -> CLICK",
"[link] Camping Tents -> CLICK",
"[link] add filter: 6-person(24) -> CLICK",
"[combobox] Sort By -> SELECT: Price: Low - High"
]
},
{
"website": "rei",
"id": "932c0ec6-d500-495a-a7a7-0f632acbf6a5",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Browse camping stoves that have an auto ignition feature.",
"action_reprs": [
"[button] Camp & Hike -> HOVER",
"[link] Stoves, Grills & Fuel -> CLICK",
"[link] add filter: Auto Ignition(30) -> CLICK"
]
},
{
"website": "rei",
"id": "ad0369b6-cfd5-4555-bb4f-d84a942be555",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Order the cheapest climbing shoes in today's deals.",
"action_reprs": [
"[button] Deals -> HOVER",
"[link] Explore Deals -> CLICK",
"[link] Climbing -> CLICK",
"[combobox] Sort By -> SELECT: Price: Low - High",
"[img] Black Diamond Zone Climbing Shoes 0 -> CLICK",
"[button] Add to cart\u2014$46.73 -> CLICK",
"[link] Cart & Checkout -> CLICK",
"[link] Proceed to checkout -> CLICK"
]
},
{
"website": "cvs",
"id": "0f9dd411-f3ab-494e-8a3a-5dc9a908f4ee",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Locate the cvs pharmacy nearest to zip code 45201 that provides hair loss evaluation and treatment.",
"action_reprs": [
"[link] Schedule a women's health exam -> CLICK",
"[link] Explore all MinuteClinic health services -> CLICK",
"[p] Skin, Hair & Nails -> CLICK",
"[span] In-Person Care -> CLICK",
"[button] Hair Loss Evaluation & Treatment -> CLICK",
"[link] Hair Loss Evaluation & Treatment -> CLICK",
"[textbox] Tell us a location Enter a ZIP code or city & stat... -> TYPE: 45201",
"[button] Find care -> CLICK"
]
},
{
"website": "newegg",
"id": "e84111f2-5193-421e-877a-9af8418b558a",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "Find a gaming desktop with an rtx4000 GPU, available in stock.",
"action_reprs": [
"[link] \ue92f Computer Systems \uf105 -> HOVER",
"[link] Gaming Desktops -> CLICK",
"[span] NVIDIA GeForce RTX 4000 -> CLICK",
"[label] ON -> CLICK"
]
},
{
"website": "qatarairways",
"id": "8d0eda4b-7a6e-45a4-bd8c-59fd3da58676",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find a one-way flight ticket from Addis Ababa to Accra on April 14 and book the cheaper economy ticket.",
"action_reprs": [
"[textbox] From Autocomplete selection. Enter your place. -> TYPE: addis ababa",
"[strong] Addis Ababa -> CLICK",
"[textbox] To Autocomplete selection. Enter your place. -> TYPE: accra",
"[strong] Accra -> CLICK",
"[option] One way -> CLICK",
"[gridcell] 14 April 2023 -> CLICK",
"[button] Continue -> CLICK",
"[button] Show flights\ue99a -> CLICK",
"[heading] ETB\u00a055,042 -> CLICK"
]
},
{
"website": "amtrak",
"id": "2089ee5c-1ccd-495e-9a80-f62e129554ed",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "What are the deals in California",
"action_reprs": [
"[button] DEALS -> CLICK",
"[link] DEALS & PROMOTIONS Amtrak travel deals, promotions... -> CLICK",
"[label] All Regions -> CLICK",
"[generic] California -> CLICK"
]
},
{
"website": "amtrak",
"id": "240952bd-853b-4653-a358-49c2784cf568",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find a train scheduled between Chicago to Los Angeles for the next day, and if a southwest chief train is available, then print the route details.",
"action_reprs": [
"[link] SCHEDULES -> CLICK",
"[input] -> TYPE: chicago",
"[option] Chicago, IL - Union Station (CHI) -> CLICK",
"[input] -> TYPE: los angeles",
"[option] Los Angeles, CA - Union Station (LAX) -> CLICK",
"[textbox] Type a date, or use enter to open, escape to close... -> CLICK",
"[gridcell] Saturday, March 25, 2023 -> CLICK",
"[button] Find Schedules -> CLICK",
"[img] -> CLICK",
"[span] -> CLICK",
"[button] Close -> CLICK",
"[img] -> CLICK",
"[div] Print Selected Train -> CLICK"
]
},
{
"website": "amazon",
"id": "581da9fe-4d75-42a7-b138-9b287a153575",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Find a pair of mens running shoes in black, size 7 extra wide, 4+ stars and under $50 and add them to my cart",
"action_reprs": [
"[textbox] Search Amazon -> TYPE: mens black running shoes",
"[button] Go -> CLICK",
"[region] 4 Stars & Up -> CLICK",
"[link] Under Armour Men's Charged Assert 9 Running Shoe -> CLICK",
"[button] 7 X-Wide -> CLICK",
"[button] Add to Cart -> CLICK"
]
},
{
"website": "amazon",
"id": "5f2c3149-1820-4632-bfdb-3cf4615de2cc",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Browse dog food for puppies that is rated at least 4 stars and sort the results by price from low to high.",
"action_reprs": [
"[textbox] Search Amazon -> TYPE: dog food",
"[button] dog food -> CLICK",
"[i] -> CLICK",
"[region] 4 Stars & Up -> CLICK",
"[span] Sort by: -> CLICK",
"[option] Price: Low to High -> CLICK"
]
},
{
"website": "ign",
"id": "851998b2-fda2-4bd4-a822-f1871a9fde12",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Browse the list of action figure items available for pre order.",
"action_reprs": [
"[button] Toggle Sidebar -> CLICK",
"[link] Store -> CLICK",
"[link] Pre-Orders -> CLICK",
"[link] Action Figures (1) -> CLICK"
]
},
{
"website": "mbta",
"id": "644b7bed-b5fb-4090-b04f-a669d41ac93a",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find the schedule of the East Boston ferry, check connections, and fares and download the pdf schedule.",
"action_reprs": [
"[button] Transit \uf0d7 -> CLICK",
"[link] Ferry -> CLICK",
"[span] East Boston Ferry -> CLICK",
"[link] Schedule & Maps -> CLICK",
"[button] Connections \uf107 -> CLICK",
"[button] Fares \uf107 -> CLICK",
"[link] East Boston ferry schedule PDF -> CLICK"
]
},
{
"website": "mbta",
"id": "8f41d9db-29fd-4c1b-9cbd-0f74fecdf520",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Show information about careers with MBTA and signup for customer service job alerts. Name: James Smith. Email: abc@abc.com",
"action_reprs": [
"[link] Careers -> CLICK",
"[link] Sign up for job posting alerts -> CLICK",
"[span] -> CLICK",
"[button] Subscribe -> CLICK",
"[textbox] First Name -> TYPE: James",
"[textbox] Last Name -> TYPE: Smith",
"[textbox] Email Address -> TYPE: abc@abc.com",
"[button] Submit -> HOVER"
]
},
{
"website": "mbta",
"id": "9223ed29-5abb-4f4d-8108-1c3a584a7017",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find information about reduced bus fares.",
"action_reprs": [
"[button] Fares \uf0d7 -> CLICK",
"[link] Bus Fares -> CLICK",
"[link] Learn more about reduced fares -> CLICK"
]
},
{
"website": "menards",
"id": "9e44c63b-2c7a-445c-b9c4-6580f4271268",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Track the status of a rebate for Monty Lue, house number 4847, zip code 10019",
"action_reprs": [
"[link] Rebate Center -> CLICK",
"[link] Track your rebates -> CLICK",
"[textbox] * Required Fields First Initial * Required Fields... -> TYPE: Monty",
"[textbox] * Required Fields Last Name * Required Fields Las... -> TYPE: Lue",
"[textbox] * Required Fields House Number -> TYPE: 4847",
"[textbox] * Required Fields ZIP Code * Required Fields Zip -> TYPE: 10019",
"[button] Search -> CLICK"
]
},
{
"website": "gamestop",
"id": "716ed90e-a138-452e-b5b5-167911871fda",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "find Playstation gift card of $10.",
"action_reprs": [
"[searchbox] Search games, consoles & more -> TYPE: playstation gift card $10",
"[button] Search -> CLICK",
"[img] -> CLICK"
]
},
{
"website": "gamestop",
"id": "7685e8ad-3989-4316-85dd-746fac2956be",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Look for a recently posted part-time Job in Gamestop stores in Fresno, California, and apply.",
"action_reprs": [
"[link] Careers -> CLICK",
"[link] View Jobs Stores -> CLICK",
"[button] State / Province -> CLICK",
"[span] -> CLICK",
"[button] City -> CLICK",
"[searchbox] City -> TYPE: fre",
"[span] -> CLICK",
"[button] Hiring Type -> CLICK",
"[span] -> CLICK",
"[combobox] Sort by -> SELECT: Most recent",
"[link] Apply Now for Guest Advisor (Store 5459) Job ID is... -> CLICK"
]
},
{
"website": "exploretock",
"id": "1efdcd9d-ebc6-4bb7-8823-e54dfe25f409",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "book a reservation for three guest on April 5th, 5pm in Alinea restaurant, Chicago, IL",
"action_reprs": [
"[button] Search -> CLICK",
"[textbox] Search -> TYPE: Alinea",
"[span] Chicago, IL - Lincoln Park -> CLICK",
"[i] -> CLICK",
"[i] -> CLICK",
"[button] Go to next month -> CLICK",
"[button] 2023-04-05 -> CLICK",
"[combobox] Desired reservation time -> SELECT: 5:00 PM",
"[link] Search within Alinea (opens a dialog) -> CLICK"
]
},
{
"website": "exploretock",
"id": "61fa0552-66ac-4572-95f2-800537cfee7b",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "check restaurant with delivery service available 6pm on Mar 25th in Detroit, MI.",
"action_reprs": [
"[combobox] Reservation type -> SELECT: Delivery",
"[svg] -> CLICK",
"[searchbox] Find a location -> TYPE: detroit",
"[span] MI, USA -> CLICK",
"[svg] -> CLICK",
"[button] 25 -> CLICK",
"[combobox] Time -> SELECT: 6:00 PM",
"[svg] -> CLICK"
]
},
{
"website": "exploretock",
"id": "6e565708-43e2-492b-9f1d-25d51387dcf7",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Find pizza serving restaurants for pick up in Chicago, sufficient for 10 people on March 30, 8:15 PM from a joint which also offers dining package.",
"action_reprs": [
"[svg] -> CLICK",
"[span] Pickup -> CLICK",
"[button] Change location -> CLICK",
"[svg] -> CLICK",
"[searchbox] Find a location -> TYPE: CHICAGO",
"[span] Chicago -> CLICK",
"[span] Mar 18 -> CLICK",
"[button] 30th March (Thursday) -> CLICK",
"[combobox] Time -> SELECT: 8:15 PM",
"[combobox] Size -> SELECT: 10 guests",
"[button] Update search -> CLICK",
"[button] Edit cuisine type filter -> CLICK",
"[checkbox] Pizza -> CLICK",
"[button] Submit -> CLICK",
"[button] Open additional search filters -> CLICK",
"[span] Dining package -> CLICK",
"[button] Update search -> CLICK"
]
},
{
"website": "travelzoo",
"id": "aeace1e7-0460-4f4e-99fb-2a8c867b97ef",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Show me the highest rated Last-Minute Flights & Car Rentals",
"action_reprs": [
"[link] Last-Minute Deals -> CLICK",
"[heading] Last-Minute Flights & Car Rentals -> CLICK",
"[button] Filter -> CLICK",
"[button] Highest Rated -> CLICK",
"[button] DONE -> CLICK"
]
},
{
"website": "travelzoo",
"id": "afa1f70c-c0ff-4e4d-a5c2-0c0d292ee066",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "find cruise deals to Europe this summer that includes airfare and are all-inclusive.",
"action_reprs": [
"[link] Cruises -> CLICK",
"[textbox] Where? -> CLICK",
"[div] Europe -> CLICK",
"[textbox] When? -> CLICK",
"[li] Summer -> CLICK",
"[button] SEARCH DEALS -> CLICK",
"[button] Filter -> CLICK",
"[button] Airfare Included -> CLICK",
"[button] All-inclusive -> CLICK",
"[button] DONE -> CLICK"
]
},
{
"website": "travelzoo",
"id": "b770af80-75f0-470c-8797-1466d90c35ce",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Get the cheapest last-minute pet-friendly road trip hotel deal in May for a single person with a pet and book.",
"action_reprs": [
"[textbox] What type of deals? -> CLICK",
"[div] Hotels -> CLICK",
"[div] Anywhere -> CLICK",
"[textbox] When? -> CLICK",
"[tab] Select a Month -> CLICK",
"[li] May -> CLICK",
"[combobox] How many guests? -> SELECT: 1 Guest",
"[button] SEARCH DEALS -> CLICK",
"[button] Filter -> CLICK",
"[button] Pet-Friendly -> CLICK",
"[button] Road Trips -> CLICK",
"[button] Last-Minute -> CLICK",
"[button] $ Price: Low to High -> CLICK",
"[button] DONE -> CLICK",
"[heading] $139 Vermont: Cozy Kimpton in the heart of Manches... -> CLICK",
"[button] CHECK DATES -> CLICK",
"[link] $189 -> CLICK",
"[link] $259 -> CLICK",
"[button] CONTINUE -> CLICK",
"[heading] $207 -> CLICK"
]
},
{
"website": "agoda",
"id": "7a698566-2a8f-4d9d-9da9-17288b66917f",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Find hotels in Tokyo for two adults and one child, with a budget of $500 per night for 2 nights starting on May 5th.",
"action_reprs": [
"[combobox] Enter a destination or property -> TYPE: Tokyo",
"[generic] Japan -> CLICK",
"[div] 5 -> CLICK",
"[div] 7 -> CLICK",
"[img] Add -> CLICK",
"[span] SEARCH -> CLICK",
"[span] SEARCH -> CLICK",
"[textbox] Maximum price filter -> TYPE: 500"
]
},
{
"website": "agoda",
"id": "8c5ccffa-b88e-4928-9394-6d46cfd36e59",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "What are today's Limited Time Offers deals?",
"action_reprs": [
"[link] Coupons & Deals -> CLICK",
"[checkbox] Limited Time Offers (5) -> CLICK"
]
},
{
"website": "agoda",
"id": "9a5aa299-e77d-44ca-ab0f-f6fd83e3fde1",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Find the cheapest and highest-rated hotel in the Navi Mumbai area of Mumbai, India, on April 12 for just one day.",
"action_reprs": [
"[combobox] Enter a destination or property -> TYPE: mumbai",
"[span] Mumbai -> CLICK",
"[span] 12 -> CLICK",
"[i] -> CLICK",
"[i] -> CLICK",
"[span] SEARCH -> CLICK",
"[tab] Lowest price first -> CLICK",
"[checkbox] list-filter-item-label-0 -> CLICK",
"[checkbox] list-filter-item-label-1 -> CLICK",
"[checkbox] list-filter-item-label-0 -> CLICK"
]
},
{
"website": "amazon",
"id": "dc636898-246e-4b08-9978-6a6dc1b20320",
"domain": "Shopping",
"subdomain": "General",
"confirmed_task": "Show mattresses available with Amazon Basics and Follow the store.",
"action_reprs": [
"[link] Amazon Basics -> CLICK",
"[link] BEDROOM -> CLICK",
"[link] Mattress & Mattress Toppers -> CLICK",
"[button] Follow Amazon Basics -> CLICK"
]
},
{
"website": "store.steampowered",
"id": "11344944-81ef-4fde-82b7-7e9724fc96f1",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Browse the list of discussion forums for games I own.",
"action_reprs": [
"[link] COMMUNITY -> HOVER",
"[link] DISCUSSIONS -> CLICK",
"[link] Game Forums -> CLICK",
"[div] Most Popular (this week) -> CLICK",
"[div] My Games -> CLICK"
]
},
{
"website": "store.steampowered",
"id": "2159d768-6657-40af-b336-ad5726fec1e2",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Add to my wishlist the top rated JRPG game.",
"action_reprs": [
"[link] Categories -> CLICK",
"[link] JRPG -> CLICK",
"[generic] TOP RATED -> CLICK",
"[generic] Persona 4 Golden PERSONA 4 GOLDEN JRPGGreat Soundt... -> HOVER",
"[svg] -> CLICK"
]
},
{
"website": "united",
"id": "0fb36232-0d2a-4115-9012-99dbaad25a5e",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find one-way flights from New York to Toronto.",
"action_reprs": [
"[span] -> CLICK",
"[combobox] Enter your departing city, airport name, or airpor... -> TYPE: New York",
"[button] New York, NY, US (NYC - All Airports) -> CLICK",
"[combobox] Enter your destination city, airport name, or airp... -> TYPE: Toronto",
"[button] Toronto, ON, CA (YYZ) -> CLICK",
"[button] Find flights -> CLICK"
]
},
{
"website": "kbb",
"id": "93d0190f-ff39-4b69-82fc-58cddac42006",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Find the safety rating for 2012 Honda Civic",
"action_reprs": [
"[link] Price New/Used -> CLICK",
"[combobox] Year -> SELECT: 2012",
"[generic] Your Opinion Counts! -> CLICK",
"[img] Close -> CLICK",
"[combobox] Make -> SELECT: Honda",
"[combobox] Model -> SELECT: Civic",
"[button] Next -> CLICK",
"[div] Safety -> CLICK"
]
},
{
"website": "kbb",
"id": "988ff1b8-c9e8-44af-a729-33f0e99c9dbf",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Show cars with AWD with maximum budget of $50,000.",
"action_reprs": [
"[link] Cars for Sale -> HOVER",
"[link] Cars for Sale -> CLICK",
"[span] AWD/4WD -> CLICK",
"[textbox] Max Price -> TYPE: 50000"
]
},
{
"website": "kbb",
"id": "9dfba9af-d79e-4a75-83b4-0f85ab04c2e6",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Get a price quote for new Kia Carnival for 11101.",
"action_reprs": [
"[link] Cars for Sale -> HOVER",
"[link] Free Dealer Price Quote -> CLICK",
"[select] Make -> SELECT: Kia",
"[select] Model -> SELECT: Carnival",
"[textbox] ZIP -> TYPE: 11101",
"[button] Find Dealers -> CLICK",
"[button] Get My Free Quotes -> HOVER"
]
},
{
"website": "cvs",
"id": "cd8f1f63-f6c3-4b1b-9ec9-3b13b9f0386c",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Read the 1 star reviews of DayQuil Severe Cough Liquicaps.",
"action_reprs": [
"[combobox] Search products and services -> TYPE: dayquil",
"[button] Submit search -> CLICK",
"[div] Vicks DayQuil SEVERE Cough, Cold & Flu Relief, 24 ... -> CLICK",
"[img] -> CLICK",
"[div] 1 star -> CLICK"
]
},
{
"website": "cvs",
"id": "d29e8a14-ee66-4330-b282-09cb1955aad0",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Browse the weekly ad in List View.",
"action_reprs": [
"[button] Savings & Memberships -> CLICK",
"[link] Weekly Ad -> CLICK",
"[tab] List View -> CLICK"
]
},
{
"website": "cvs",
"id": "e638beb6-059f-40ea-8653-929221e997db",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find a comprehensive health screening for women in 10003.",
"action_reprs": [
"[span] Schedule a women's health exam -> CLICK",
"[link] Comprehensive health screening Available in-person -> CLICK",
"[textbox] Tell us a location Enter a ZIP code or city & stat... -> CLICK",
"[textbox] Tell us a location Enter a ZIP code or city & stat... -> TYPE: 10003",
"[button] Find care -> CLICK",
"[div] Clinic details -> CLICK"
]
},
{
"website": "newegg",
"id": "92cfe78f-0385-4ef6-b829-ae34291e766f",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "Find an LED TV below $1000.",
"action_reprs": [
"[generic] Site Menu -> CLICK",
"[link] TV & Home Theater \uf105 -> CLICK",
"[div] TV & Accessories -> CLICK",
"[link] LED TV -> CLICK",
"[dt] Price -> CLICK",
"[textbox] price to -> TYPE: 1000",
"[button] APPLY -> CLICK",
"[img] Samsung 65\" Class Q80B Series QLED 4K Smart TV (QN... -> CLICK"
]
},
{
"website": "newegg",
"id": "74e653f0-aeea-4f01-8d80-c5846fae0c1c",
"domain": "Shopping",
"subdomain": "Digital",
"confirmed_task": "Show the Recommended Gaming PCs for someone who plays Fortnite, Overwatch and GTA V at 4k",
"action_reprs": [
"[generic] Site Menu -> CLICK",
"[link] icon of Gaming PC Finder Gaming PC Finder -> CLICK",
"[div] Remove -> CLICK",
"[div] Remove -> CLICK",
"[p] Remove -> CLICK",
"[button] 4K -> CLICK",
"[button] VIEW RESULTS -> CLICK"
]
},
{
"website": "store.steampowered",
"id": "29f639c1-20da-46a6-b9c5-bbec77ac3c03",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Open community discussions for Dota 2 game and open latest topic.",
"action_reprs": [
"[link] COMMUNITY -> HOVER",
"[link] DISCUSSIONS -> CLICK",
"[link] Game Forums -> CLICK",
"[textbox] Search by game -> TYPE: Dota 2",
"[div] Dota 2 -> CLICK",
"[a] -> CLICK"
]
},
{
"website": "store.steampowered",
"id": "3236b068-8eaf-4a39-913f-b71884a35c39",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Show me the most played games sorted by daily player count.",
"action_reprs": [
"[link] New & Noteworthy -> CLICK",
"[link] Most Played -> CLICK",
"[generic] By Current Players -> CLICK",
"[div] By Daily Players -> CLICK"
]
},
{
"website": "store.steampowered",
"id": "3bb1c925-71ef-4713-a139-a3be65f8a7a5",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Show reviews for Fallout 4 and mark the first one as helpful.",
"action_reprs": [
"[textbox] search -> TYPE: Fallout 4",
"[link] Fallout 4 $19.99 -> CLICK",
"[select] 1900 -> SELECT: 1995",
"[link] View Page -> CLICK",
"[link] Yes -> CLICK"
]
},
{
"website": "store.steampowered",
"id": "3c9442f9-5542-4395-918a-6551dbba3e3a",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Show Massively Multiplayer games which can be played on VR.",
"action_reprs": [
"[link] Massively Multiplayer -> CLICK",
"[generic] VR -> CLICK",
"[button] Show more -> CLICK"
]
},
{
"website": "store.steampowered",
"id": "3d83f3de-58f2-4aba-9b02-4a230d35a4ef",
"domain": "Entertainment",
"subdomain": "Game",
"confirmed_task": "Find the highest rated adventure game available for early access.",
"action_reprs": [
"[link] Categories -> HOVER",
"[link] Early Access -> CLICK",
"[div] Narrow By -> CLICK",
"[link] Adventure -> CLICK",
"[generic] TOP RATED -> CLICK",
"[link] SATISFACTORY -> CLICK"
]
},
{
"website": "expedia",
"id": "5ea9ec16-845e-4a99-8848-fd96e8bad254",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Find flights from Los Angeles to Miami for two people departing on July 1st and returning on July 7th.",
"action_reprs": [
"[tab] Flights -> CLICK",
"[button] Leaving from -> TYPE: Los Angeles, CA",
"[button] Los Angeles (LAX - Los Angeles Intl.) California, ... -> CLICK",
"[button] Going to -> TYPE: Miami, FL",
"[textbox] Going to -> TYPE: Miami, FL",
"[button] Miami (MIA - Miami Intl.) Florida, United States -> CLICK",
"[button] 1 traveler -> CLICK",
"[img] Increase adults -> CLICK",
"[button] Departing April 11, 2023 -> CLICK",
"[button] Next month -> CLICK",
"[button] Next month -> CLICK",
"[button] Jul 1, 2023 -> CLICK",
"[button] Jul 7, 2023 -> CLICK",
"[button] Done : (Save changes and close the date picker.) -> CLICK",
"[button] Search -> CLICK"
]
},
{
"website": "delta",
"id": "e4cf5835-4726-4a84-bc8f-5023e95ddec9",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "search for SkyMiles domestic Award Deals from Philadelphia to Atlanta.",
"action_reprs": [
"[tab] SkyMiles -> CLICK",
"[link] SkyMiles Award Deals -> CLICK",
"[combobox] Origin -> CLICK",
"[option] PHL Philadelphia, PA -> CLICK",
"[combobox] Destination -> CLICK",
"[option] ATL Atlanta, GA -> CLICK",
"[button] Filters -> CLICK",
"[combobox] Select Region Type -> CLICK",
"[option] Domestic & North America -> CLICK",
"[button] FILTER SUBMIT -> CLICK"
]
},
{
"website": "delta",
"id": "e783cb30-26d8-45b8-b3d3-04570566bd32",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Check Flight status on 21 April for flight number DL145.",
"action_reprs": [
"[tab] FLIGHT STATUS -> CLICK",
"[span] Mon, Apr 10 -> CLICK",
"[link] 21 April 2023, Friday -> CLICK",
"[button] done -> CLICK",
"[spinbutton] Flight Number (Required) -> CLICK",
"[spinbutton] Flight Number (Required) -> TYPE: DL145",
"[button] \ue91a SUBMIT -> CLICK"
]
},
{
"website": "delta",
"id": "e92a2c89-3310-434b-9543-a0d896881bb9",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find premium car in Brooklyn for a day.",
"action_reprs": [
"[tab] Travel Info -> CLICK",
"[link] Rent A Car -> CLICK",
"[button] Pick-up -> TYPE: Brooklyn",
"[button] Brooklyn New York, United States -> CLICK",
"[button] Search -> CLICK",
"[input] -> CLICK",
"[input] -> CLICK",
"[button] Reserve -> HOVER"
]
},
{
"website": "expedia",
"id": "56cfe20a-f008-48d3-b683-002ce7790616",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Find cheapest luxury car rental in New York for two with pickup from JFK airport at 9am, April 3 and drop off at JFK on 6pm, April 6",
"action_reprs": [
"[tab] Cars -> CLICK",
"[button] Pick-up -> CLICK",
"[textbox] Pick-up -> TYPE: jfk",
"[button] New York (JFK - John F. Kennedy Intl.) New York, U... -> CLICK",
"[button] Same as pick-up -> CLICK",
"[textbox] Same as pick-up -> TYPE: jfk",
"[button] New York (JFK - John F. Kennedy Intl.) New York, U... -> CLICK",
"[button] Pick-up date April 5, 2023 -> CLICK",
"[button] Apr 3, 2023 -> CLICK",
"[button] Apr 6, 2023 -> CLICK",
"[button] Done : (Save changes and close the date picker.) -> CLICK",
"[combobox] Pick-up time -> SELECT: 9:00 am",
"[combobox] Drop-off time -> SELECT: 6:00 pm",
"[button] Search -> CLICK",
"[input] -> CLICK",
"[input] -> CLICK",
"[combobox] Sort by -> SELECT: Total Price"
]
},
{
"website": "marriott",
"id": "c9740663-a6aa-4aee-919a-330a9f2b3091",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Find highest rated room for one adult in Los Angeles, CA between May 7 to May 14 which offers senior discount, free breakfast, is pet friendly and has a pool",
"action_reprs": [
"[textbox] \ue900DESTINATION WHERE CAN WE TAKE YOU?SEARCH FROM CUR... -> TYPE: Los Angeles",
"[span] , CA, USA -> CLICK",
"[button] \ue9571 NIGHT Sat, Apr 08 - Sun, Apr 09 -> CLICK",
"[span] 7 -> CLICK",
"[span] 14 -> CLICK",
"[button] Done -> CLICK",
"[button] Lowest Regular Rate\ue932 -> CLICK",
"[label] Senior Discount -> CLICK",
"[button] Find Hotels -> CLICK",
"[combobox] Sort by: -> CLICK",
"[option] Guest Rating -> CLICK",
"[link] Pets welcome (118) -> CLICK",
"[link] Free breakfast (57) -> CLICK",
"[link] Pool (56) -> CLICK"
]
},
{
"website": "ryanair",
"id": "2742f638-cf66-4c72-a6a6-69f2a12bc269",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Search for a flight on May 9 and return on May 16 from Tel Aviv to Venice with plus type fare option.",
"action_reprs": [
"[textbox] From -> TYPE: TEL AVIV",
"[span] Tel Aviv -> CLICK",
"[textbox] To -> TYPE: VENICE",
"[span] Venice Treviso -> CLICK",
"[div] May -> CLICK",
"[generic] 9 -> CLICK",
"[generic] 16 -> CLICK",
"[button] Search -> CLICK",
"[button] Select -> CLICK",
"[button] Select -> CLICK",
"[heading] $ 49 . 50 more -> CLICK"
]
},
{
"website": "ryanair",
"id": "3e50b35f-7af9-4835-a741-158c2d941722",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find the cheapest room for Athens, Attica, Greece 1 Apr 2023 - 3 Apr 2023, 2 nights, 1 Room, 1 Adult",
"action_reprs": [
"[div] hotels -> CLICK",
"[textbox] Destination or property -> TYPE: Athens, Attica, Greeece",
"[div] , Greece -> CLICK",
"[div] Choose date -> CLICK",
"[generic] 1 -> CLICK",
"[div] Choose date -> CLICK",
"[generic] 3 -> CLICK",
"[button] Search -> CLICK",
"[button] Yes, I agree -> CLICK",
"[span] Lowest price -> CLICK",
"[button] Choose room -> CLICK"
]
},
{
"website": "cabelas",
"id": "9f76268f-9a4e-4eab-ab2c-262d2fe7bdee",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Browse crossbows on sale with limited stock.",
"action_reprs": [
"[link] Hunting -> CLICK",
"[menuitem] Crossbows and Accessories -> CLICK",
"[label] Limited Stock -> CLICK",
"[label] Sale -> CLICK",
"[label] Crossbows -> CLICK"
]
},
{
"website": "cabelas",
"id": "a4397261-95a5-4d57-a531-6082b2af8ac3",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find a black sleeping pad that is under $40.",
"action_reprs": [
"[textbox] Search -> TYPE: black sleeping bag",
"[button] Search -> CLICK",
"[textbox] Upper Bound -> TYPE: 40",
"[textbox] Lower Bound -> TYPE: 0",
"[button] GO -> CLICK"
]
},
{
"website": "new.mta.info",
"id": "92ba0696-bc54-41c9-8ddf-1a2f44420c6f",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Plan an accessible trip from empire state building to little Caribbean with least walking",
"action_reprs": [
"[searchbox] From -> CLICK",
"[searchbox] From -> TYPE: empire state building",
"[listitem] Empire State Building, West 34th Street, New York,... -> CLICK",
"[searchbox] To -> CLICK",
"[searchbox] To -> TYPE: little caribbean",
"[listitem] Little Caribbean, Brooklyn, NY, USA -> CLICK",
"[button] Open Travel Preferences modal. -> CLICK",
"[combobox] Minimize my -> SELECT: Walking",
"[button] Done button - Press enter key to submit travel pre... -> CLICK",
"[label] Accessible Trip -> CLICK",
"[link] Plan my Trip - Press enter key to submit the form ... -> CLICK"
]
},
{
"website": "travelzoo",
"id": "4a9a05f8-6c23-46c5-bb38-eec63a477475",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Find adults only, airfare included vacations in Mexico during the month of May",
"action_reprs": [
"[textbox] What type of deals? -> CLICK",
"[div] Vacations -> CLICK",
"[textbox] Where? -> TYPE: mexico",
"[div] Mexico -> CLICK",
"[textbox] When? -> CLICK",
"[tab] Select a Month -> CLICK",
"[li] May -> CLICK",
"[button] Filter -> CLICK",
"[button] Adults-Only -> CLICK",
"[button] Airfare Included -> CLICK",
"[button] DONE -> CLICK"
]
},
{
"website": "travelzoo",
"id": "4e44e7b6-3d2a-4ca2-870a-edc9e9751d5d",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Find the cheapest last minute cruise deal",
"action_reprs": [
"[link] Last-Minute Deals -> CLICK",
"[heading] Last-Minute Cruise Deals -> CLICK",
"[button] Filter -> CLICK",
"[button] $ Price: Low to High -> CLICK",
"[button] DONE -> CLICK"
]
},
{
"website": "amtrak",
"id": "06ed65ba-d2d3-4114-a67f-4622ec357aa3",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find the empire builder route in West US part of heartland and check the Minnesota stop.",
"action_reprs": [
"[button] DESTINATIONS -> CLICK",
"[polygon] -> CLICK",
"[button] Heartland -> CLICK",
"[link] The page with details for The Heart of America wil... -> CLICK",
"[button] Minn.-St. Paul -> CLICK"
]
},
{
"website": "amtrak",
"id": "0b70e49b-2759-4276-ad4f-471e405544b9",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "View all conductor trainee job openings in Amtrak New York and apply to the latest job.",
"action_reprs": [
"[link] Careers -> CLICK",
"[textbox] Search by Keyword -> TYPE: Conductor",
"[textbox] Search by Location -> TYPE: New Yok",
"[button] To make this website accessible to screen reader, ... -> CLICK",
"[button] To make this website accessible to screen reader, ... -> CLICK",
"[link] To make this website accessible to screen reader, ... -> CLICK",
"[link] To make this website accessible to screen reader, ... -> CLICK"
]
},
{
"website": "amtrak",
"id": "1d9c6a43-eeb3-40ec-8617-d09a68fb0fb3",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Show me routes from NYP to WAS on May 15th.",
"action_reprs": [
"[textbox] From -> CLICK",
"[option] New York, NY - Moynihan Train Hall (NYP) -> CLICK",
"[textbox] To -> TYPE: was",
"[option] Washington, DC - Union Station (WAS) -> CLICK",
"[textbox] Depart Date -> CLICK",
"[gridcell] Monday, May 15, 2023 -> CLICK",
"[button] FIND TRAINS -> CLICK"
]
},
{
"website": "mbta",
"id": "14be9a2b-5559-423b-8362-4dccf306992e",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find rail for Oyster Bay, Provincetown.",
"action_reprs": [
"[link] commuter rail Commuter Rail -> CLICK",
"[combobox] Search for a line -> TYPE: Oyster Bay",
"[span] Oyster -> CLICK",
"[link] Go to route -> CLICK"
]
},
{
"website": "mbta",
"id": "408cc1bd-0a76-4bad-b5f4-11db4405047f",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Plan a trip from Boston Logan Airport to North Station.",
"action_reprs": [
"[tab] Trip Planner -> CLICK",
"[combobox] From -> TYPE: Boston Logan Airport",
"[option] Boston Logan Int'l Airport, 1 Harborside Dr, East ... -> CLICK",
"[combobox] To\u00a0 -> TYPE: North Station",
"[link] T orange line green line D green line E commuter ... -> CLICK",
"[button] Get trip suggestions -> CLICK"
]
},
{
"website": "mbta",
"id": "41ff100f-582a-422e-b387-3abd9008cee4",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Open red line subway schedule.",
"action_reprs": [
"[button] Transit \uf0d7 -> CLICK",
"[link] Subway -> CLICK",
"[span] Red Line -> CLICK"
]
},
{
"website": "mbta",
"id": "4ff347e6-e911-4af5-8151-7805a9e91b28",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Show current alerts for red line subway.",
"action_reprs": [
"[tab] Alerts -> CLICK",
"[link] red line -> CLICK",
"[link] Current Alerts -> CLICK"
]
},
{
"website": "mbta",
"id": "504c0c6b-7e78-4bfa-ae3f-00f8e59c3693",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find a parking lot in Gloucester and book a ride from there to North Plymouth on April 28, 2:30 pm, view the map to understand the route better.",
"action_reprs": [
"[button] Transit \uf0d7 -> CLICK",
"[link] Parking -> CLICK",
"[link] Find Parking Lots -> CLICK",
"[button] Stations G\u2013K \uf107 -> CLICK",
"[link] Gloucester -> CLICK",
"[link] Plan a trip from this station -> CLICK",
"[combobox] To\u00a0 -> TYPE: NORTH PLYMOUTH",
"[em] Plymouth -> CLICK",
"[button] Depart at 8:20 AM, 4/10/23 \uf107 -> CLICK",
"[LabelText] Monday, April 10, 2023, click or press the enter o... -> CLICK",
"[gridcell] Friday, April 28, 2023 -> CLICK",
"[combobox] Hour -> TYPE: 2",
"[combobox] Minute -> TYPE: 30",
"[combobox] AM or PM -> SELECT: PM",
"[button] Get trip suggestions -> CLICK",
"[button] Show map and trip details \uf107 -> CLICK"
]
},
{
"website": "marriott",
"id": "8e4dbb21-de6c-4b9a-8bd1-97fc6b1fe3c0",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Find a wedding venue in Venice Beach California in June for 100 guests.",
"action_reprs": [
"[button] Find & Reserve -> CLICK",
"[link] Book Meetings & Events -> CLICK",
"[heading] Weddings -> CLICK",
"[label] Purpose of your event -> CLICK",
"[li] Wedding -> CLICK",
"[textbox] Destination -> TYPE: Venice Beach",
"[menuitem] Venice Beach, Los Angeles, CA, USA -> CLICK",
"[textbox] Event space -> TYPE: 100",
"[textbox] Start Date -> CLICK",
"[button] \ue023 -> CLICK",
"[button] \ue023 -> CLICK",
"[button] \ue023 -> CLICK",
"[gridcell] Sun, Jun 4, 2023 -> CLICK",
"[div] Start Date -> CLICK",
"[button] Find -> CLICK",
"[heading] Le M\u00e9ridien Delfina Santa Monica -> CLICK"
]
},
{
"website": "marriott",
"id": "8eef04e2-3d51-4a0e-84f2-db017a69050b",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Get the Promo Code for Spring Break Savings and packages.",
"action_reprs": [
"[button] Special Offers -> CLICK",
"[link] Deals -> CLICK",
"[heading] Spring Break Savings & Packages -> CLICK",
"[li] Promotional Code: ZJL -> CLICK"
]
},
{
"website": "marriott",
"id": "acc13b3d-0585-4cbe-a2b1-30c6e25517fa",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Shop for a Four Points by Sheraton gift card of value 150 dollars with Marriott deluxe box and add it to the cart in the name of Clara from James with a happy Christmas message and checkout.",
"action_reprs": [
"[button] For Guests\ue91e -> CLICK",
"[link] Gift Cards \ue922 -> CLICK",
"[link] Browse Gift Cards -> CLICK",
"[button] Our Brands -> CLICK",
"[img] Travel Reinvented. -> CLICK",
"[textbox] *Amount -> TYPE: 150",
"[span] Marriott Deluxe Box -> CLICK",
"[textbox] To -> TYPE: Clara",
"[textbox] From -> TYPE: James",
"[textbox] Message Line 1 -> TYPE: Happy Christmas",
"[button] Add to Cart -> CLICK",
"[button] Proceed to Checkout -> CLICK"
]
},
{
"website": "eventbrite",
"id": "63388e25-a4a3-416d-bc9b-bb915fbca977",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Find popular free online fashion class events occurring this weekend in English, find details of the top result event, save the event and follow the organizer of this event.",
"action_reprs": [
"[button] This weekend -> CLICK",
"[link] See more -> CLICK",
"[label] -> CLICK",
"[label] -> CLICK",
"[button] View more -> CLICK",
"[label] -> CLICK",
"[label] -> CLICK",
"[label] -> CLICK",
"[svg] -> CLICK",
"[div] RawElegant.Life -> CLICK",
"[div] Envy Yourself With Beauty Makeup MasterClass -> CLICK",
"[button] Follow -> CLICK"
]
},
{
"website": "eventbrite",
"id": "6b54b029-bff8-49a7-acca-c57163f14279",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Find music events in Los Angeles today",
"action_reprs": [
"[div] Search for events -> CLICK",
"[textbox] Search events -> TYPE: music",
"[combobox] autocomplete -> TYPE: los angeles ",
"[div] Los Angeles -> CLICK",
"[path] -> CLICK",
"[svg] -> CLICK",
"[button] Today -> CLICK"
]
},
{
"website": "yelp",
"id": "ea8737b0-0ff4-4476-b97d-5677d4f526dc",
"domain": "Travel",
"subdomain": "Restaurant",
"confirmed_task": "Find the highest-rated locksmith in San Francisco for a key extraction from a vehicle.",
"action_reprs": [
"[link] Home Services -> HOVER",
"[span] Locksmiths -> CLICK",
"[textbox] Near -> TYPE: SAN FRANSISCO",
"[span] San Francisco, CA -> CLICK",
"[button] All -> CLICK",
"[radio] Key extraction -> CLICK",
"[radio] Vehicle -> CLICK",
"[generic] 2 filters Key extraction \u2022 Vehicle Clear all Cance... -> CLICK",
"[button] Recommended -> CLICK",
"[span] Highest Rated -> CLICK"
]
},
{
"website": "thetrainline",
"id": "09660a8d-b01d-4e93-9dd2-0b4af256bc80",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Change the language to UK English and the currency to Euros",
"action_reprs": [
"[svg] -> CLICK",
"[combobox] Language -> SELECT: \ud83c\uddec\ud83c\udde7 English (UK)",
"[svg] -> CLICK",
"[combobox] Currency -> SELECT: Euro (EUR/\u20ac)"
]
},
{
"website": "thetrainline",
"id": "3110612f-63fe-4a7a-98d0-29c806d6a34f",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find the Trains in Spain guide that will help you learn about Renfe fare types",
"action_reprs": [
"[img] header.burgerMenu.title -> CLICK",
"[menuitem] European trains -> CLICK",
"[menuitem] Spain train tickets -> CLICK",
"[link] Renfe fare types -> CLICK"
]
},
{
"website": "thetrainline",
"id": "35646414-520b-4de0-90e0-5dfeafd850a3",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Book a lowest priced ticket from Bristal airport to London Paddington on April 8 after 2 pm, seating must be forward facing window side with power socket.",
"action_reprs": [
"[combobox] Departure station, none selected. Select a station... -> TYPE: BRISTOL",
"[span] Bristol Airport (By Bus) -> CLICK",
"[combobox] Arrival station, none selected. Select a station. -> TYPE: LONDON",
"[span] London Paddington -> CLICK",
"[textbox] Date use format: 25-Mar-23 -> CLICK",
"[link] 8 -> CLICK",
"[listbox] hour -> SELECT: 14",
"[listbox] minutes -> SELECT: 00",
"[button] Get cheapest tickets -> CLICK",
"[span] Continue -> CLICK",
"[listbox] Direction -> SELECT: Forward facing",
"[listbox] Position -> SELECT: Window",
"[div] -> CLICK",
"[span] Continue -> CLICK"
]
},
{
"website": "thetrainline",
"id": "44dcda68-082c-455a-a409-7091470cc006",
"domain": "Travel",
"subdomain": "Ground",
"confirmed_task": "Find tickets from Edinburgh Waverly to Glagsgow Central on May 18, leaving nearest 3PM for 1 adult with a Veterans Railcard",
"action_reprs": [
"[combobox] Departure station, none selected. Select a station... -> CLICK",
"[combobox] Departure station, none selected. Select a station... -> TYPE: Edinburgh",
"[span] Edinburgh (Waverley) -> CLICK",
"[combobox] Arrival station, none selected. Select a station. -> CLICK",
"[combobox] Arrival station, none selected. Select a station. -> TYPE: Glasgow",
"[span] Glasgow Central -> CLICK",
"[textbox] Date use format: 17-Mar-23 -> CLICK",
"[path] -> CLICK",
"[link] 18 -> CLICK",
"[listbox] hour -> SELECT: 15",
"[svg] -> CLICK",
"[button] Add railcard -> CLICK",
"[listbox] Select railcard 01 -> SELECT: Veterans Railcard",
"[button] Done -> CLICK",
"[button] Get cheapest tickets -> CLICK"
]
},
{
"website": "tvguide",
"id": "c9215395-70cd-4da5-af99-9ba36cde858a",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Find the trailer for a new winter show from HBO.",
"action_reprs": [
"[link] Recommendations -> CLICK",
"[link] Recommendations -> HOVER",
"[menuitem] Winter Preview: New Shows Worth Watching -> CLICK",
"[link] Trailer -> CLICK"
]
},
{
"website": "tvguide",
"id": "d0ce3db1-720b-4333-a487-2bdc8fd74a80",
"domain": "Entertainment",
"subdomain": "Movie",
"confirmed_task": "Show episodes of Alien Worlds and check where to watch Episode 4 of Season 1.",
"action_reprs": [
"[textbox] Search TV Shows and Movies... -> TYPE: Alien Worlds",
"[div] Alien Worlds -> CLICK",
"[link] Seasons & Episodes -> CLICK",
"[span] Where to Watch -> CLICK"
]
},
{
"website": "uniqlo",
"id": "f8089c50-e80c-4532-82a1-96009f485c57",
"domain": "Shopping",
"subdomain": "Fashion",
"confirmed_task": "Find a Women's t-shirt for $40-$60 and add it to Wishlist, stop at the Login screen.",
"action_reprs": [
"[link] WOMEN -> CLICK",
"[tab] Tops -> CLICK",
"[link] T-Shirts -> CLICK",
"[gridcell] Price -> CLICK",
"[label] $40-$60 -> CLICK",
"[svg] -> CLICK",
"[svg] -> CLICK",
"[button] LOG IN -> CLICK"
]
},
{
"website": "united",
"id": "0b16b42c-dea7-4079-a2a8-79eb23447193",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find popular deals to USA national parks in the southeast region of Biscayne national park, and add to the cart the fully refundable economy flight from New York to Miami with a departure date of May 13 and a return date of May 18.",
"action_reprs": [
"[tab] DEALS -> CLICK",
"[link] Flights to national parks -> CLICK",
"[heading] Southeast Region -> CLICK",
"[link] Within sight of downtown Miami, yet worlds away, B... -> CLICK",
"[link] Fly to Miami (MIA) -> CLICK",
"[button] New York/Newark (EWR) Miami (MIA) Roundtrip|Econom... -> CLICK",
"[textbox] Departure -> CLICK",
"[gridcell] Saturday, May 13, 2023 -> CLICK",
"[gridcell] Thursday, May 18, 2023 -> CLICK",
"[button] Search flights -> CLICK",
"[span] Refundable fares -> CLICK",
"[radio] Show refundable fares from $258 -> CLICK",
"[div] Select flight -> CLICK",
"[div] Add to cart -> CLICK"
]
},
{
"website": "gamestop",
"id": "8a6f2641-9896-4657-b447-56927420e8c4",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find the cheapest educational trade-in Nintendo switch game rated for everyone, and print the details.",
"action_reprs": [
"[link] repeat Trade-In -> CLICK",
"[p] Video Games -> CLICK",
"[link] Filter -> CLICK",
"[generic] Refine by Category: Nintendo Switch -> CLICK",
"[checkbox] Everyone Everyone -> CLICK",
"[button] Genre -> CLICK",
"[checkbox] Educational Educational -> CLICK",
"[button] Done -> CLICK",
"[button] Best Matches -> CLICK",
"[link] Price Low To High -> CLICK",
"[link] Comic Coloring Book - Nintendo Switch -> CLICK",
"[link] PRINT -> CLICK"
]
},
{
"website": "agoda",
"id": "e3486ac5-6d1e-476f-b389-2e6df37f94bd",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "Search a cheapest homestay with balcony in Bali, Indoneshia from April 1 to 4 for 2 adults and 4 children aged 3, 5, 8, and 12 years, respectively, double beds prefered, including breakfast.",
"action_reprs": [
"[combobox] Enter a destination or property -> TYPE: bali",
"[generic] Indonesia -> CLICK",
"[gridcell] Sat Apr 01 2023 -> CLICK",
"[button] 4 -> CLICK",
"[img] Add -> CLICK",
"[img] Add -> CLICK",
"[combobox] Age of Child 1(Child's age (years)) -> SELECT: 3",
"[img] Add -> CLICK",
"[combobox] Age of Child 2(Child's age (years)) -> SELECT: 5",
"[img] Add -> CLICK",
"[combobox] Age of Child 3(Child's age (years)) -> SELECT: 8",
"[img] Add -> CLICK",
"[combobox] Age of Child 4(Child's age (years)) -> SELECT: 12",
"[span] SEARCH -> CLICK",
"[span] SEARCH -> CLICK",
"[checkbox] list-filter-item-label-4 -> CLICK",
"[checkbox] list-filter-item-label-12 -> CLICK",
"[checkbox] list-filter-item-label-3 -> CLICK",
"[checkbox] list-filter-item-label-0 -> CLICK",
"[tab] Lowest price first -> CLICK"
]
},
{
"website": "agoda",
"id": "fbe9f625-7b47-4e13-a2f5-6823195d7438",
"domain": "Travel",
"subdomain": "General",
"confirmed_task": "find a cheapest direct flight From mumbai to new delhi, India, on june 1 and return travel on june 8.",
"action_reprs": [
"[tab] Flights -> CLICK",
"[generic] Round-trip -> CLICK",
"[combobox] Flying from -> TYPE: MUMBAI",
"[option] Airport Chhatrapati Shivaji Maharaj International ... -> CLICK",
"[combobox] Flying to -> TYPE: NEW DELHI",
"[option] Airport Indira Gandhi International Airport -> CLICK",
"[button] Next Month -> CLICK",
"[use] -> CLICK",
"[div] 1 -> CLICK",
"[span] 8 -> CLICK",
"[span] SEARCH FLIGHTS -> CLICK",
"[span] Direct -> CLICK"
]
},
{
"website": "sports.yahoo",
"id": "0692908b-4bf4-48ac-b41a-37c59ea5ba1d",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "find the score of the latest nfl game played by the las vegas raiders.",
"action_reprs": [
"[combobox] Search query -> TYPE: las vegas raiders",
"[img] Las Vegas -> CLICK",
"[div] Final -> CLICK"
]
},
{
"website": "united",
"id": "90a0f029-c1af-4dd7-8ccd-c4c2a74e8731",
"domain": "Travel",
"subdomain": "Airlines",
"confirmed_task": "Find a basic economy flight + hotel for an award travel from las vegas to san francisco leaving and returning on any date on april for 1 traveler and one room",
"action_reprs": [
"[tab] BOOK -> CLICK",
"[link] Award travel -> CLICK",
"[span] Flight + hotel -> CLICK",
"[label] Basic Economy -> CLICK",
"[combobox] Enter your departing city, airport name, or airpor... -> TYPE: las vegas",
"[span] Las Vegas, NV -> CLICK",
"[combobox] Enter your destination city, airport name, or airp... -> TYPE: san francisco",
"[span] San Francisco, CA -> CLICK",
"[textbox] Departure -> CLICK",
"[button] Tuesday, April 11, 2023 -> CLICK",
"[button] Friday, April 14, 2023 -> CLICK",
"[button] 1 Traveler -> CLICK",
"[textbox] 1 Adults, 18 to 64 years old, 1 of 8 passengers se... -> TYPE: 1",
"[combobox] undefined Selected 1 room -> CLICK",
"[option] 1 room -> CLICK",
"[button] Find trips -> CLICK"
]
},
{
"website": "koa",
"id": "b2dd00ff-3f09-46bf-a043-7b996f3815da",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Search for holiday campground in Alaska.",
"action_reprs": [
"[link] CAMPING AT KOA \uf0d7 -> CLICK",
"[link] KOA HOLIDAY CAMPGROUNDS \uf0da -> CLICK",
"[button] Alaska -> CLICK",
"[link] Homer / Baycrest KOA Holiday\ue250 -> CLICK"
]
},
{
"website": "koa",
"id": "b4872f0e-9d9e-4259-8b1e-844509b85712",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Find all campgrounds located in California.",
"action_reprs": [
"[link] FIND A CAMPGROUND \uf0d7 -> CLICK",
"[link] FIND BY STATE/PROVINCE \uf0da -> CLICK",
"[link] California -> CLICK"
]
},
{
"website": "koa",
"id": "b7e501a4-5dee-406e-b6ba-00eed783df0c",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Find a KOA campground in California that has RV sites.",
"action_reprs": [
"[link] Filters -> CLICK",
"[checkbox] RV Site -> CLICK",
"[textbox] WHERE DO YOU WANT TO GO? -> TYPE: California",
"[button] FIND A KOA -> CLICK"
]
},
{
"website": "koa",
"id": "c7b0d1bc-2a0c-4060-92dd-cd4b8721b625",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Search for KOA near Lansing, Michigan for June 7, 2023 to June 12, 2023.",
"action_reprs": [
"[textbox] WHERE DO YOU WANT TO GO? -> TYPE: Lansing",
"[list] KOA Logo Icon Auburn Hills / Holly KOA Holly, MI K... -> CLICK",
"[textbox] CHECK IN -> CLICK",
"[link] \uf054 Next -> CLICK",
"[link] \uf054 Next -> CLICK",
"[link] 7 -> CLICK",
"[textbox] CHECK OUT -> CLICK",
"[link] 12 -> CLICK",
"[button] FIND A KOA -> CLICK"
]
},
{
"website": "koa",
"id": "d3ca5294-89aa-4028-8776-be08edc63783",
"domain": "Travel",
"subdomain": "Hotel",
"confirmed_task": "Find a campground in Phoenix with wi-fi to check in today.",
"action_reprs": [
"[textbox] WHERE DO YOU WANT TO GO? -> TYPE: Phoenix",
"[textbox] CHECK IN -> CLICK",
"[link] 9 -> CLICK",
"[link] Filters -> CLICK",
"[checkbox] Wi-Fi -> CLICK",
"[button] FIND A KOA -> CLICK"
]
},
{
"website": "kohls",
"id": "06309af8-9ca0-41c4-8acc-1e4e5db2f344",
"domain": "Shopping",
"subdomain": "Department",
"confirmed_task": "Show the most popular Women's Athletic Shoes.",
"action_reprs": [
"[span] Shop by Category -> CLICK",
"[link] Women -> HOVER",
"[link] Shoes & Sandals -> CLICK",
"[link] Athletic Shoes & Sneakers Athletic Shoes & Sneaker... -> CLICK",
"[link] Sort by: Featured -> CLICK",
"[link] Best Sellers -> CLICK"
]
},
{
"website": "nyc",
"id": "f5d4d405-9714-47a5-a66a-49a899b16b97",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "check all available tickets within $100 to $200 for the New York Knicks first game on April2 nd.",
"action_reprs": [
"[link] sports. -> CLICK",
"[textbox] Search by Name -> TYPE: New york knicks",
"[p] New York Knicks -> CLICK",
"[link] View Tickets -> CLICK",
"[span] (0) -> CLICK",
"[textbox] Max Price -> TYPE: 200",
"[textbox] Min Price -> TYPE: 100",
"[button] Done -> CLICK"
]
},
{
"website": "eventbrite",
"id": "ddee9314-5a29-4258-b11b-b6432ec719f1",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "Search for all free virtual business start-up events happening tomorrow in Las Vegas and follow the organizer with most followers.",
"action_reprs": [
"[link] Business -> CLICK",
"[svg] -> CLICK",
"[combobox] autocomplete -> TYPE: LAS VEGAS",
"[div] Las Vegas -> CLICK",
"[svg] -> CLICK",
"[div] Tomorrow -> CLICK",
"[p] Startups & Small Business -> CLICK",
"[div] #virtual -> CLICK",
"[label] -> CLICK",
"[div] How to Make Six-Figures as a Consultant or Coach -... -> CLICK",
"[button] Following -> CLICK"
]
},
{
"website": "eventbrite",
"id": "e9300d50-11fa-4f98-8c39-424630668ab9",
"domain": "Entertainment",
"subdomain": "Event",
"confirmed_task": "What are the popular online Health events for tomorr\now?",
"action_reprs": [
"[link] Health -> CLICK",
"[heading] Most popular events -> CLICK",
"[p] Search for online events -> CLICK",
"[label] -> CLICK"
]
},
{
"website": "ikea",
"id": "1d0dcb84-da65-4830-ba60-cc2b09a52a13",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find plastic bathroom baskets that are gray from low to high prices near zip code 60173.",
"action_reprs": [
"[link] Products -> CLICK",
"[button] Bathroom -> CLICK",
"[link] Bathroom storage -> CLICK",
"[searchbox] Search by ZIP code or city, state -> TYPE: 60173",
"[button] Submit -> CLICK",
"[span] Select store -> CLICK",
"[textbox] Enter zip code to save preferred delivery location... -> TYPE: 60173",
"[span] Update ZIP code -> CLICK",
"[span] See all bathroom boxes & baskets -> CLICK",
"[button] Show filter modal Color -> CLICK",
"[checkbox] Gray 12 products -> CLICK",
"[button] Show filter modal Material -> CLICK",
"[span] -> CLICK",
"[span] Plastic -> CLICK",
"[button] Show sorting options modal -> CLICK",
"[radio] Price: low to high -> CLICK"
]
},
{
"website": "ikea",
"id": "2d4b44c7-d11a-41c1-8be7-af4ae80b7a8c",
"domain": "Shopping",
"subdomain": "Speciality",
"confirmed_task": "Find a store near 11231 zip code.",
"action_reprs": [
"[span] Columbus -> CLICK",
"[searchbox] Search by ZIP code or city, state -> TYPE: 11231",
"[button] Submit -> CLICK",
"[button] Set Brooklyn as my store and close modal -> CLICK"
]
},
{
"website": "carmax",
"id": "957878ba-cb47-40d1-bf37-23039b2dff27",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "find a CarMax in Michigan, 49107 and book an appointment for a car repair on April 7th..",
"action_reprs": [
"[button] Open helpful links menu -> CLICK",
"[link] Service & Repairs -> CLICK",
"[link] FIND A SHOP NEAR YOU -> CLICK",
"[link] Find a Shop -> CLICK",
"[li] 43065 -> TYPE: 49107",
"[textbox] Zip Code -> TYPE: 49107",
"[div] 49107 - Buchanan, MI -> CLICK",
"[button] Request Appointment -> CLICK",
"[gridcell] Fri Apr 07 2023 -> CLICK"
]
},
{
"website": "carmax",
"id": "9e3d2edb-6535-4180-9050-ade88dbf798e",
"domain": "Shopping",
"subdomain": "Auto",
"confirmed_task": "Find a Chevrolet with lowest mileage in zip 08817 with shipping charges of 99 dollars or less, with a price between 20k to 30k.",
"action_reprs": [
"[span] Columbus Easton -> CLICK",
"[searchbox] Enter ZIP or State -> TYPE: 08817",
"[button] Search for CarMax stores. -> CLICK",
"[button] set store -> CLICK",
"[link] Shop -> CLICK",
"[link] SHOP ALL CARS -> CLICK",
"[div] Best match -> CLICK",
"[label] Lowest mileage -> CLICK",
"[button] Back to all categories -> CLICK",
"[heading] Distance & Shipping -> CLICK",
"[button] Any -> CLICK",
"[menuitem] $99 or less -> CLICK",
"[path] -> CLICK",
"[button] Make -> CLICK",
"[listitem] Chevrolet (101) Chevrolet (101) -> CLICK",
"[button] Back to all categories -> CLICK",
"[button] Price -> CLICK",
"[button] $10,000 -> CLICK",
"[menuitem] $20,000 -> CLICK",
"[button] $56,000 + -> CLICK",
"[menuitem] $30,000 -> CLICK",
"[button] Back to all categories -> CLICK",
"[generic] select car -> CLICK"
]
},
{
"website": "sports.yahoo",
"id": "0c577209-47dc-4645-8d10-0b659663a969",
"domain": "Entertainment",
"subdomain": "Sports",
"confirmed_task": "find the score of the latest nba game played by the phoenix suns.",
"action_reprs": [
"[combobox] Search query -> TYPE: phoenix suns",
"[link] Phoenix Phoenix NBA -> CLICK",
"[span] Final -> CLICK"
]
}
]
Reference in New Issue View Git Blame Copy Permalink