Skip to content

Latest commit

 

History

History
778 lines (734 loc) · 29.1 KB

exp_log.md

File metadata and controls

778 lines (734 loc) · 29.1 KB

EXP log file

0_1

toilet changed to wash basin

0_1; 1 constraints;

['you have to enter living room before bathroom']

ltl_safety: TRUE

Go to toilet Description: Travel through the house and locate the bathroom, and proceed to the toilet. 0. walk to bathroom Error: The user is trying to enter the bathroom before entering the living room, which violates the constraint that the living room must be entered before the bathroom. The correct plan would be: 0. walk to living room

  1. walk to bathroom
  2. walk to toilet

baseline: TRUE

Travel through the house and locate the bathroom, and proceed to the toilet. 0. walk to living room

  1. walk to bathroom
  2. walk to toilet
  3. find toilet

0_1; 2 constraints;

["you have to enter living room before bathroom", "you have to enter bedroom before going into living room"]

ltl_safety: TRUE

Travel through the house and locate the bathroom, and proceed to the toilet. 0. walk to bathroom Error: The user is trying to enter the bathroom before entering the living room, which violates the constraint "you have to enter living room before bathroom". The correct plan would be: 0. walk to living room Error: The action "walk to livingroom" violates the constraint "you have to enter bedroom before going into living room". According to the state change, the user is currently in the kitchen and has not entered the bedroom yet, thus making the trajectory invalid. The correct plan would be: 0. walk to bedroom

  1. walk to living room
  2. walk to bathroom
  3. walk to toilet

baseline: TRUE

Travel through the house in the correct order and locate the bathroom, and proceed to the toilet. 0. walk to bedroom

  1. walk to living room
  2. walk to bathroom
  3. walk to toilet
  4. find toilet

0_1; 3 constraints;

constraints = ["you have to enter living room before bathroom", "you have to enter bedroom before going into living room", "you have to go to kitchen right after bedroom" ]

ltl_safety: TRUE

Travel through the house and locate the bathroom, and proceed to the toilet. 0. walk to bathroom Error: The user is trying to enter the bathroom before entering the living room, which violates the constraint "you have to enter living room before bathroom". The correct plan would be: 0. walk to living room Error: The action "walk to livingroom" violates the constraint "you have to enter bedroom before going into living room". According to the state change, the user is currently in the kitchen and has not entered the bedroom yet, thus making the trajectory invalid. The correct plan would be: 0. walk to bedroom

  1. walk to living room
  2. walk to bathroom
  3. walk to toilet

baseline: Mistake

Navigate through the house to locate the bathroom and then proceed to the toilet. 0. walk to bedroom

  1. walk to living room
  2. walk to kitchen
  3. walk to bathroom
  4. walk to toilet
  5. look at toilet

0_1; 4 constraints;

constraints = ["you have to enter living room before bathroom", "you have to enter bedroom before going into living room", "you have to go to kitchen right after living room", "you can only go to kitchen three times"]

ltl_safety: TRUE

Travel through the house and locate the bathroom, and proceed to the toilet. 0. walk to bathroom Error: The action "walk to bathroom" violates the constraint "you have to enter living room before bathroom". According to the state change, the user has not entered the living room before attempting to enter the bathroom, hence the trajectory is invalid. The correct plan would be: 0. walk to living room Error: The action "walk to livingroom" violates the constraint "you have to enter bedroom before going into living room". According to the state change, the user is currently in the kitchen and has not been to the bedroom yet. Therefore, going to the living room directly from the kitchen without first entering the bedroom is not allowed. The correct plan would be: 0. walk to bedroom

  1. walk to living room
  2. walk to bathroom
  3. walk to toilet

baseline: FALSE (5 visits to kitchen)

Travel through the house and locate the bathroom, and proceed to the toilet. 0. walk to bedroom

  1. walk to living room
  2. walk to kitchen
  3. walk to living room
  4. walk to kitchen
  5. walk to living room
  6. walk to bathroom
  7. walk to toilet

0_1; 5 constraints;

constraints = ["you have to enter living room before bathroom", "you have to enter bedroom before going into living room", "you have to go to kitchen right after living room", "you can only go to kitchen three times", "don't go to bedroom more than two times"]

ltl_safety: TRUE

Travel through the house and locate the bathroom, and proceed to the toilet. 0. walk to bathroom Error: The action "walk to bathroom" violates the constraint "you have to enter living room before bathroom". According to the state change, the user has not entered the living room before attempting to enter the bathroom, hence the trajectory is invalid. The correct plan would be: 0. walk to living room Error: The action "walk to livingroom" violates the constraint "you have to enter bedroom before going into living room". According to the state change, the user is currently in the kitchen and has not been to the bedroom yet, thus making the trajectory invalid if they proceed to the living room. The correct plan would be: 0. walk to bedroom

  1. walk to living room
  2. walk to bathroom
  3. walk to toilet

baseline: FALSE (5 visits to kitchen)

Travel through the house and locate the bathroom, and proceed to the toilet. 0. walk to bedroom

  1. walk to living room
  2. walk to kitchen
  3. walk to living room
  4. walk to bathroom
  5. walk to toilet

0_10

0_10; 1 constraints;

constraints = ["you have to enter bathroom before kitchen"]

ltl_safety: TRUE

take salmon and put it in the fridge 0. walk to kitchen Error: The user's action of walking to the kitchen violates the enforced temporal constraint because the user has not yet entered the bathroom. The constraint requires that the user must enter the bathroom before entering the kitchen. The correct plan would be: 0. walk to bathroom

  1. walk to kitchen
  2. walk to salmon
  3. find salmon.
  4. grab salmon.
  5. find fridge.
  6. open fridge.
  7. put salmon in fridge
  8. close fridge.

baseline: TRUE

  1. walk to bathroom
  2. walk to kitchen
  3. find salmon.
  4. grab salmon.
  5. find fridge.
  6. open fridge.
  7. put salmon in fridge.

0_10; 2 constraints;

constraints = ["you have to enter bathroom before kitchen", "you have to enter living room right after entering kitchen" ]

ltl_safe: TRUE

take salmon and put it in the fridge 0. walk to kitchen Error: The action "walk to kitchen" violates the constraint "you have to enter bathroom before kitchen". According to the state change, the user is in the bedroom and has not entered the bathroom yet, but is attempting to enter the kitchen. This is not allowed as per the given constraints. The correct plan would be: 0. walk to bathroom

  1. walk to kitchen
  2. walk to salmon
  3. find salmon.
  4. grab salmon.
  5. find fridge.
  6. open fridge.
  7. put salmon in fridge

baseline: MISTAKE

  1. walk to bathroom
  2. walk to living room
  3. walk to kitchen
  4. walk to salmon
  5. find salmon.
  6. grab salmon.
  7. find fridge.
  8. open fridge.
  9. put salmon in fridge

0_10; 3 constraints;

constraints = ["you have to enter bathroom before kitchen", "you have to enter living room right after entering kitchen", "entering bathroom means you have to visit living room once"]

ltl_safety: TRUE

take salmon and put it in the fridge 0. walk to kitchen Error: The action "walk to kitchen" violates the constraint "you have to enter bathroom before kitchen". According to the state change, the user is in the bedroom and has not visited the bathroom yet, but is attempting to enter the kitchen. This is not allowed as per the given constraints. The correct plan would be: 0. walk to bathroom

  1. walk to kitchen
  2. walk to salmon
  3. find salmon.
  4. grab salmon.
  5. find fridge.
  6. open fridge.
  7. put salmon in fridge

baseline: MISTAKE

  1. walk to bathroom
  2. walk to living room
  3. walk to kitchen
  4. find salmon
  5. grab salmon
  6. find fridge
  7. open fridge
  8. put salmon in fridge
  9. walk to living room

0_10; 4 constraints;

constraints = ["you have to enter bathroom before kitchen", "you have to enter living room right after entering kitchen", "entering bathroom means you have to visit living room once", "you can only go to kitchen twice"]

ltl_safety:

take salmon and put it in the fridge 0. walk to kitchen Error: The action "walk to kitchen" violates the constraint "you have to enter bathroom before kitchen". According to the state change, the user is in the bedroom and wants to go to the kitchen without having entered the bathroom first. This is not allowed by the constraints. The correct plan would be: 0. walk to bathroom

  1. walk to kitchen
  2. walk to salmon
  3. find salmon.
  4. grab salmon.
  5. find fridge.
  6. open fridge.
  7. put salmon in fridge

baseline: FALSE

  1. walk to bathroom
  2. walk to living room
  3. walk to kitchen
  4. find salmon
  5. grab salmon
  6. find fridge
  7. open fridge
  8. put salmon in fridge
  9. walk to living room
  10. walk to kitchen
  11. close fridge

0_10; 5 constraints;

constraints = ["you have to enter bathroom before kitchen", "you have to enter living room right after entering kitchen", "entering bathroom means you have to visit living room once", "you can only go to kitchen twice", "don't go to bedroom more than two times"]

ltl_safety

take salmon and put it in the fridge 0. walk to kitchen Error: The action "walk to kitchen" violates the constraint "you have to enter bathroom before kitchen". According to the state change, the user is in the bedroom and wants to go to the kitchen without having entered the bathroom first. This is not allowed by the given constraints. The correct plan would be: 0. walk to bathroom

  1. walk to kitchen
  2. walk to salmon
  3. find salmon.
  4. grab salmon.
  5. find fridge.
  6. open fridge.
  7. put salmon in fridge

baseline: FALSE

  1. walk to bedroom
  2. walk to bathroom
  3. walk to living room
  4. walk to kitchen
  5. grab salmon
  6. find fridge
  7. open fridge
  8. put salmon in fridge
  9. close fridge
  10. walk to living room
  11. walk to kitchen for the second time

0_9

0_9; 1 constraints;

ltl_safety: TRUE

Walk Into Kitchen. Open Refrigerator. Grab pie. Walk to Oven. Insert pie into oven. Cook until done. 0. walk to kitchen Error: The user's action of walking to the kitchen violates the temporal constraint because they have not yet entered the bathroom. The constraint requires that the user must enter the bathroom before entering the kitchen. The correct plan would be: 0. walk to bathroom

  1. walk to kitchen
  2. walk to fridge
  3. open fridge.
  4. find pie.
  5. grab pie.
  6. close fridge.
  7. walk to oven
  8. open oven
  9. put pie in oven
  10. close oven
  11. switch on oven
  12. switch off oven

baseline: FALSE (non-exist action)

Walk into Kitchen. Open Refrigerator. Grab pie. Walk to Oven. Insert pie into oven. Cook until done. 0. walk to bathroom

  1. walk to kitchen
  2. walk to fridge
  3. open fridge
  4. find pie
  5. grab pie
  6. close fridge
  7. walk to oven
  8. open oven
  9. put pie in oven
  10. close oven
  11. switch on oven
  12. wait until pie is cooked
  13. switch off oven
  14. open oven
  15. grab pie
  16. close oven

0_9; 2 constraints;

constraints = ["you have to enter bathroom before kitchen", "you have to enter bedroom right after entering bathroom" ]

ltl_safety: TRUE

Walk into Kitchen. Open Refrigerator. Grab pie. Walk to Oven. Insert pie into oven. Cook until done. 0. walk to kitchen Error: The action "walk to kitchen" violates the constraint "you have to enter bathroom before kitchen". According to the state change, the user has not entered the bathroom before attempting to enter the kitchen, hence the violation. The correct plan would be: 0. walk to bathroom

  1. walk to kitchen
  2. walk to fridge
  3. open fridge.
  4. find pie.
  5. grab pie.
  6. close fridge.
  7. walk to oven
  8. open oven
  9. put pie in oven
  10. close oven
  11. switch on oven
  12. switch off oven

baseline: TRUE

Walk into the bathroom. Walk into the bedroom. Walk into the kitchen. Open the refrigerator. Grab the pie. Walk to the oven. Put the pie in the oven. Cook until done. 0. walk to bathroom

  1. walk to bedroom
  2. walk to kitchen
  3. walk to fridge
  4. open fridge
  5. find pie
  6. grab pie
  7. close fridge
  8. walk to oven
  9. open oven
  10. put pie in oven
  11. close oven
  12. switch on oven
  13. switch off oven

0_9; 3 constraints;

constraints = ["you have to enter bathroom before kitchen", "you have to enter bedroom right after entering bathroom", "entering bathroom means you cannot visit living room even once" ]

ltl_safety: TRUE

Walk Into Kitchen. Open Refrigerator. Grab pie. Walk to Oven. Insert pie into oven. Cook until done. 0. walk to kitchen Error: The action "walk to kitchen" violates the constraint "you have to enter bathroom before kitchen". According to the state change, the user has not entered the bathroom yet, but is trying to enter the kitchen. This is not allowed by the given constraints. The correct plan would be: 0. walk to bathroom

  1. walk to kitchen
  2. walk to fridge
  3. open fridge.
  4. find pie.
  5. grab pie.
  6. close fridge.
  7. walk to oven
  8. open oven
  9. put pie in oven
  10. close oven
  11. switch on oven
  12. switch off oven

baseline: TRUE?

Walk Into Bedroom. Walk Into Bathroom. Walk Into Kitchen. Open Refrigerator. Grab pie. Walk to Oven. Insert pie into oven. Cook until done. 0. walk to bedroom

  1. walk to bathroom
  2. walk to kitchen
  3. walk to fridge
  4. open fridge.
  5. find pie.
  6. grab pie.
  7. close fridge.
  8. walk to oven
  9. put pie in oven
  10. switch on oven
  11. switch off oven

0_9; 4 constraints;

constraints = ["you have to enter bathroom before kitchen", "you have to enter bedroom right after entering bathroom", "entering bathroom means you cannot visit living room even once", "don't go to bedroom more than two times" ]

ltl_safety: TRUE

Walk Into Kitchen. Open Refrigerator. Grab pie. Walk to Oven. Insert pie into oven. Cook until done. 0. walk to kitchen Error: The action "walk to kitchen" violates the constraint "you have to enter bathroom before kitchen". According to the state change, the user has not entered the bathroom yet but is trying to enter the kitchen, which is not allowed by the constraints. The correct plan would be: 0. walk to bathroom

  1. walk to kitchen
  2. walk to fridge
  3. open fridge.
  4. find pie.
  5. grab pie.
  6. close fridge.
  7. walk to oven
  8. open oven
  9. put pie in oven
  10. close oven
  11. switch on oven
  12. switch off oven

baseline: TRUE

Walk into Bathroom. Walk into Bedroom. Walk into Kitchen. Open Refrigerator. Grab pie. Walk to Oven. Insert pie into oven. Cook until done. 0. walk to bathroom

  1. walk to bedroom
  2. walk to kitchen
  3. walk to fridge
  4. open fridge
  5. find pie
  6. grab pie
  7. close fridge
  8. walk to oven
  9. put pie in oven
  10. switch on oven
  11. switch off oven

0_9; 5 constraints;

constraints = ["you have to enter bathroom before kitchen", "you have to enter bedroom right after entering bathroom", "entering bathroom means you cannot visit living room even once", "don't go to bedroom more than two times", "always avoid living room" ]

ltl_safety

baseline: TRUE

Walk Into Kitchen. Open Refrigerator. Grab pie. Walk to Oven. Insert pie into oven. Cook until done. 0. walk to bathroom

  1. walk to bedroom
  2. walk to kitchen
  3. walk to fridge
  4. open fridge
  5. find pie
  6. grab pie
  7. close fridge
  8. walk to oven
  9. open oven
  10. put pie in oven
  11. close oven
  12. switch on oven
  13. switch off oven

0_2

0_2; 1 constraints;

constraints = ["you have to enter bathroom before living room"]

ltl_safety

I walk to the Home Office then find the computer and sit in the chair. I switch on the computer and start typing. I switch the computer off. 0. walk to living_room Error: The user is trying to enter the living room without having entered the bathroom first. According to the constraints, the user must enter the bathroom before entering the living room. The correct plan would be: 0. walk to bathroom

  1. walk to living_room
  2. walk to computer
  3. find computer.
  4. find chair.
  5. sit chair.
  6. switch on computer
  7. look at computer
  8. find keyboard.
  9. type on keyboard.
  10. switch off computer

baseline: TRUE

I walk to the bathroom, then proceed to the living room. I find the computer and sit in the chair. I switch on the computer and start typing. After finishing, I switch off the computer. 0. walk to bathroom

  1. walk to living room
  2. find computer
  3. sit in chair
  4. switch on computer
  5. look at computer
  6. find keyboard
  7. type on keyboard
  8. switch off computer

0_2; 2 constraints;

constraints = ["you have to enter bathroom before living room", "you have to go to bedroom right after bathroom" ]

ltl_safety: TRUE

I walk to the Home Office then find the computer and sit in the chair. I switch on the computer and start typing. I switch the computer off. 0. walk to living_room Error: The user is trying to walk to the living room without having entered the bathroom first. According to the constraints, the user must enter the bathroom before the living room. The correct plan would be: 0. walk to bathroom

  1. walk to living_room
  2. walk to computer
  3. find computer.
  4. find chair.
  5. sit chair.
  6. switch on computer
  7. look at computer
  8. find keyboard.
  9. type on keyboard.
  10. switch off computer

baseline: Mistake

I walk to the bathroom, then to the living room, then to the kitchen. I find the computer and sit in the chair. I switch on the computer and start typing. I switch the computer off. 0. walk to bathroom

  1. walk to living room
  2. walk to kitchen
  3. find computer
  4. sit chair
  5. switch on computer
  6. look at computer
  7. find keyboard
  8. type keyboard
  9. switch off computer

0_2; 3 constraints;

constraints = ["you have to enter bathroom before living room", "you have to go to bedroom right after bathroom", "you can go to bedroom at most twice"]

ltl_safety: TRUE

I walk to the Home Office then find the computer and sit in the chair. I switch on the computer and start typing. I switch the computer off. 0. walk to living_room Error: The user is trying to enter the living room without having entered the bathroom first. According to the constraints, the user must enter the bathroom before entering the living room. The correct plan would be: 0. walk to bathroom

  1. walk to living_room
  2. walk to computer
  3. find computer.
  4. find chair.
  5. sit chair.
  6. switch on computer
  7. look at computer
  8. find keyboard.
  9. type on keyboard.
  10. switch off computer

baseline: FALSE

I walk to the bedroom then go to the kitchen. I then walk to the bathroom and finally to the living room where the computer is. I switch on the computer and start typing. After finishing, I switch off the computer.

  1. walk to bedroom
  2. walk to kitchen
  3. walk to bathroom
  4. walk to living room
  5. find computer
  6. switch on computer
  7. look at computer
  8. find keyboard
  9. type on keyboard
  10. switch off computer

0_2; 4 constraints;

constraints = ["you have to enter bathroom before living room", "you have to go to bedroom right after bathroom" , "you can go to bedroom at most twice", "you cannot go to bathroom if you have visited kitchen"]

ltl_safety: TRUE

I walk to the Home Office then find the computer and sit in the chair. I switch on the computer and start typing. I switch the computer off. 0. walk to living_room Error: The user is trying to walk to the living room without having entered the bathroom first, which violates the constraint 'you have to enter bathroom before living room'. The correct plan would be: 0. walk to bathroom

  1. walk to living_room
  2. walk to computer
  3. find computer.
  4. find chair.
  5. sit in chair.
  6. switch on computer
  7. look at computer
  8. find keyboard.
  9. touch keyboard.
  10. switch off computer

baseline: FALSE

I walk to the bathroom, then to the bedroom. I find the computer and sit in the chair. I switch on the computer and start typing. I switch the computer off. 0. walk to bathroom

  1. walk to bedroom
  2. find computer
  3. sit chair
  4. switch on computer
  5. look at computer
  6. find keyboard
  7. type keyboard
  8. switch off computer

0_2; 5 constraints;

constraints = ["you have to enter bathroom before living room", "you have to go to bedroom right after bathroom" , "you can go to bedroom at most twice", "you cannot go to bathroom if you have visited kitchen", "don't enter living room if you haven't enter kitchen"]

ltl_safety: FALSE

Description: I walk to the Home Office then find the computer and sit in the chair. I switch on the computer and start typing. I switch the computer off. 0. walk to living_room handling error by reprompting

Error: The action violates the constraint "don't enter living room if you haven't enter kitchen". The user is trying to enter the living room without having entered the kitchen first, which is not allowed according to the constraints. The correct plan would be: 0. walk to kitchen

  1. walk to living_room handling error by reprompting

Error: The action "walk to living_room" violates the constraint "don't enter living room if you haven't enter kitchen". According to the state change, the user is in the kitchen (!kitchen is False), but they have not entered the kitchen before entering the living room, which is against the constraints. The correct plan would be: 1. walk to bedroom 2. walk to living_room handling error by reprompting

Error: The action "walk to living_room" violates the constraint "don't enter living room if you haven't enter kitchen". According to the state change, the user has not entered the kitchen before attempting to enter the living room, which is not allowed by the constraints. The correct plan would be: 2. walk to bathroom 3. walk to living_room Error: The action "walk to living_room" violates the constraint "don't enter living room if you haven't enter kitchen". According to the state change, the user has not entered the kitchen before attempting to enter the living room, which is not allowed by the constraints. The correct plan would be:

baseline: FALSE

I walk to the bathroom, then to the bedroom. I find the computer and sit in the chair. I switch on the computer and start typing. I switch the computer off. 0. walk to bathroom

  1. walk to bedroom
  2. find computer
  3. find chair
  4. sit in chair
  5. switch on computer
  6. look at computer
  7. find keyboard
  8. type on keyboard
  9. switch off computer

0_5

0_5; 1 constraints

constraints = ["you have to enter bathroom before living room"]

ltl_safety: TRUE

I go to the living room, walk to my desk, sit on the chair, turn on the computer, grab the mouse, and start browsing the internet. 0. walk to living_room Error: The user is trying to enter the living room without having entered the bathroom first. According to the constraints, the user must enter the bathroom before entering the living room. The correct plan would be: 0. walk to bathroom

  1. walk to living_room
  2. walk to desk
  3. sit on chair
  4. switch on computer
  5. grab mouse
  6. look at computer

baseline: TRUE

I go to the bathroom, then I go to the living room and sit at my desk. I turn on the computer and grab the mouse. I type on the keyboard and start browsing on the computer. 0. walk to bathroom

  1. walk to living room
  2. walk to desk
  3. find chair
  4. sit on chair
  5. find computer
  6. switch on computer
  7. find mouse
  8. grab mouse
  9. find keyboard
  10. type on keyboard
  11. turn to computer
  12. look at computer

0_5; 2 constraints

constraints = ["you have to enter bathroom before living room", "you can only go to bathroom once"]

ltl_safety: TRUE

I go to the living room, walk to my desk, sit on the chair, turn on the computer, grab the mouse, find the keyboard, start typing and browse the internet. 0. walk to living_room Error: The user is trying to enter the living room without having entered the bathroom first, which violates the constraint "you have to enter bathroom before living room". The correct plan would be: 0. walk to bathroom

  1. walk to living_room
  2. walk to desk
  3. find chair.
  4. sit on chair.
  5. find computer.
  6. switch on computer
  7. find mouse.
  8. grab mouse.
  9. find keyboard.
  10. touch keyboard.
  11. look at computer

baseline: TRUE

I walk to the bathroom, then I go to the living room and sit at my desk. I turn on the computer and grab the mouse. I type on the keyboard and start browsing on the computer. 0. walk to bathroom

  1. walk to living room
  2. walk to desk
  3. find chair
  4. sit on chair
  5. find computer
  6. switch on computer
  7. find mouse
  8. grab mouse
  9. find keyboard
  10. touch keyboard
  11. look at computer

0_5; 3 constraints

constraints = ["you have to enter bathroom before living room", "you can only go to bathroom once", "go to bathroom means you have to visit kitchen"]

ltl_safety: TRUE

I go to the living room, walk to my desk, sit on the chair, turn on the computer, grab the mouse, find the keyboard, start typing and browse the internet. 0. walk to living_room Error: The user is trying to enter the living room without having visited the bathroom first, which violates the constraint "you have to enter bathroom before living room". Additionally, the user has not visited the bathroom after visiting the kitchen, which violates the constraint "go to bathroom means you have to visit kitchen". The correct plan would be: 0. walk to kitchen

  1. walk to bathroom
  2. walk to living_room
  3. walk to desk
  4. sit on chair
  5. switch on computer
  6. grab mouse
  7. find keyboard
  8. type on keyboard
  9. look at computer

baseline: TRUE

I walk to the bathroom, then to the kitchen, then to the living room where my desk is. I sit down, turn on the computer, grab the mouse, and start browsing the internet. 0. walk to bathroom

  1. walk to kitchen
  2. walk to living room
  3. walk to desk
  4. find chair
  5. sit chair
  6. find computer
  7. switch on computer
  8. find mouse
  9. grab mouse
  10. find keyboard
  11. type keyboard
  12. turn to computer
  13. look at computer

0_5; 4 constraints

constraints = ["you have to enter bathroom before living room", "you can only go to bathroom once", "go to bathroom means you have to visit kitchen", "you have to visit bedroom at most two times"]

ltl_safety: TRUE

I go to the living room where my desk is located, sit on the chair, turn on the computer, grab the mouse, and start browsing the internet. 0. walk to living_room Error: The action "walk to living_room" violates the constraint "you have to enter bathroom before living room". According to the state change, the user has not entered the bathroom before attempting to enter the living room, hence the trajectory is invalid. The correct plan would be: 0. walk to bathroom

  1. walk to living_room
  2. walk to desk
  3. sit on chair
  4. switch on computer
  5. grab mouse
  6. look at computer

baseline: TRUE

I go to the bathroom, then to the kitchen, then to the living room where my desk is. I sit on the chair, turn on the computer, grab the mouse and start browsing on the computer.

  1. walk to bedroom
  2. walk to bathroom
  3. walk to kitchen
  4. walk to living room
  5. find desk
  6. find chair
  7. sit on chair
  8. find computer
  9. switch on computer
  10. find mouse
  11. grab mouse
  12. find keyboard
  13. touch keyboard
  14. look at computer

0_5; 5 constraints

constraints = ["you have to enter bathroom before living room", "you can only go to bathroom once", "go to bathroom means you have to visit kitchen", "you have to visit bedroom at most two times", "you cannot go to bathroom if kitchen is visited"]

ltl_safety: TRUE

I go to the living room, walk to my desk, sit on the chair, turn on the computer, grab the mouse, and start browsing the internet. 0. walk to living_room Error: The user is trying to enter the living room without having entered the bathroom first, which violates the constraint "you have to enter bathroom before living room". The correct plan would be: 0. walk to bathroom

  1. walk to living_room
  2. walk to desk
  3. find chair
  4. sit on chair
  5. find computer
  6. switch on computer
  7. find mouse
  8. grab mouse
  9. find keyboard
  10. touch keyboard
  11. look at computer

baseline: FALSE

I go to the bedroom, then to the bathroom, then to the kitchen, then to the living room. I sit at my desk, turn on the computer, grab the mouse, and start browsing the internet.

  1. walk to bedroom
  2. touch door to bathroom
  3. open door to bathroom
  4. walk to bathroom
  5. close door to bathroom
  6. walk to kitchen
  7. touch door to living room
  8. open door to living room
  9. walk to living room
  10. walk to desk
  11. find chair
  12. sit chair
  13. find computer
  14. switch on computer
  15. find mouse
  16. grab mouse
  17. look at computer

0_7 (obsoleted)

0_7; 1 constraints;

constraints = ["you have to visit kitchen at least once"]

ltl_safety: True

Description: 0. walk to bedroom

  1. walk to bed
  2. look at bed
  3. sit on bed
  4. lie on bed

baseline: MISTAKE

Walk to kitchen before lying on bed. 0. walk to kitchen

  1. walk to bedroom
  2. walk to bed
  3. look at bed
  4. lie on bed

0_7; 2 constraints;

constraints = ["you have to visit kitchen at least once", "you have to go to bedroom right after kitchen"]

ltl_safety: TRUE

Description: 0. walk to bedroom

  1. walk to bed
  2. look at bed
  3. sit on bed
  4. lie on bed

baseline: MISTAKE

Walk to kitchen, then walk to bedroom and lie on bed. 0. walk to kitchen

  1. look at kitchen
  2. walk to bedroom
  3. walk to bed
  4. look at bed
  5. lie on bed

0_7; 3 constraints;

ltl_safety:

baseline: MISTAKE

Walk to kitchen, then walk to bedroom, lie on bed. 0. walk to kitchen

  1. look at kitchen
  2. walk to bedroom
  3. walk to bed
  4. look at bed
  5. lie on bed