forked from YzyLmc/brown-lab-talks
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
6 changed files
with
59 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,24 @@ | ||
--- | ||
# Name of the speaker | ||
name: Aldo Pacchiano | ||
|
||
# Link to the speaker's webpage | ||
webpage: https://www.aldopacchiano.ai/ | ||
|
||
# Primary affiliation of the speaker | ||
affil: Broad Institute | ||
# Link to the speaker's primary affiliation | ||
affil_link: https://www.broadinstitute.org/ | ||
|
||
# An image of the speaker (square aspect ratio works the best) (place in the `assets/img/speakers` directory) | ||
img: aldopacchiano.jpeg | ||
|
||
# # (Optional) Secondary affiliation of the speaker | ||
# affil2: BuzzFizz Corp | ||
# # Link to the speaker's secondary affiliation | ||
# affil2_link: https://buzzfizz.corp | ||
--- | ||
|
||
<!-- Whatever you write below will show up as the speaker's bio --> | ||
|
||
In settings where there is a significant overhead to deploying adaptive algorithms -- for example, when the execution of the data collection policies is required to be distributed, or a human in the loop is needed to implement these policies -- producing in advance a set of policies for data collection is paramount. We study the setting where a large dataset of contexts but not rewards is available and may be used by the learner to design an effective data collection strategy. Although when rewards are linear this problem has been well studied, results are still missing for more complex reward models. In this work we propose two experiment planning strategies compatible with function approximation. The first is an eluder planning and sampling procedure that can recover optimality guarantees depending on the eluder dimension of the reward function class. For the second, we show that a uniform sampler achieves competitive optimality rates in the setting where the number of actions is small. We finalize our results introducing a statistical gap fleshing out the fundamental differences between planning and adaptive learning and provide results for planning with model selection. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,24 @@ | ||
--- | ||
# Name of the speaker | ||
name: Kate Darling | ||
|
||
# Link to the speaker's webpage | ||
webpage: https://www.katedarling.org/ | ||
|
||
# Primary affiliation of the speaker | ||
affil: MIT Media Lab | ||
# Link to the speaker's primary affiliation | ||
affil_link: https://www.media.mit.edu/ | ||
|
||
# An image of the speaker (square aspect ratio works the best) (place in the `assets/img/speakers` directory) | ||
img: katedarling.jpeg | ||
|
||
# # (Optional) Secondary affiliation of the speaker | ||
# affil2: BuzzFizz Corp | ||
# # Link to the speaker's secondary affiliation | ||
# affil2_link: https://buzzfizz.corp | ||
--- | ||
|
||
<!-- Whatever you write below will show up as the speaker's bio --> | ||
|
||
__TBD__ |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
In settings where there is a significant overhead to deploying adaptive algorithms -- for example, when the execution of the data collection policies is required to be distributed, or a human in the loop is needed to implement these policies -- producing in advance a set of policies for data collection is paramount. We study the setting where a large dataset of contexts but not rewards is available and may be used by the learner to design an effective data collection strategy. Although when rewards are linear this problem has been well studied, results are still missing for more complex reward models. In this work we propose two experiment planning strategies compatible with function approximation. The first is an eluder planning and sampling procedure that can recover optimality guarantees depending on the eluder dimension of the reward function class. For the second, we show that a uniform sampler achieves competitive optimality rates in the setting where the number of actions is small. We finalize our results introducing a statistical gap fleshing out the fundamental differences between planning and adaptive learning and provide results for planning with model selection. |
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters