| ideaSubmitFormInstruction | startDate | votingAllowed | newCampaign | status | commentCount | challenge-id | moderatorAdminOnlyIdeasEnabled | funnelId | ideaFromUnauthorizedMemberAllowed | tagline | groupName | hideIdeaAuthor | template | campaignAttributes | attributes | total-prize-awarded-cash | external-url | submission-end | why-use-prizes | submission-start | fiscal-year | public-voting-end-date | budget-and-resources | total-prize-offered-cash | campaign-owner | public-voting-start-date | legal-authority | total-number-of-prizes-awarded | evaluation-of-submissions | agency-id | solicitation-of-submissions | total-submission-received | total-number-of-participant | show-winners-instead-of-prizes | estimated-value-of-partner-contributions | non-monetary-incentives-awarded | partner-agencies-federal | judging-end-date | solicitation-methods | advancing-the-agency-mission | rules | submission-start-date-1 | hide-challenge-timeline | judging-start-date | winners-announced-date | cash-prizes-and-non-cash-prize-awards | campaign-owner-email | solution-type | partner-agencies-non-federal | original-post-id | total-number-of-winners-awarded | hosting | hide-challenge-funnel | type-of-challenge | participation-requirements | number-of-phases | how-to-enter | partnerships | groupAttributes | judging-criteria-description-0 | judging-criteria-percentage-0 | judging-criteria-0 | judging-criteria-description-1 | judging-criteria-percentage-1 | judging-criteria-1 | judging-criteria-description-10 | judging-criteria-percentage-10 | judging-criteria-10 | judging-criteria-description-11 | judging-criteria-percentage-11 | judging-criteria-11 | judging-criteria-description-12 | judging-criteria-12 | judging-criteria-percentage-12 | judging-criteria-description-13 | judging-criteria-13 | judging-criteria-percentage-13 | judging-criteria-percentage-14 | judging-criteria-14 | judging-criteria-description-14 | judging-criteria-percentage-15 | judging-criteria-15 | judging-criteria-description-15 | judging-criteria-16 | judging-criteria-percentage-16 | judging-criteria-description-16 | judging-criteria-17 | judging-criteria-percentage-17 | judging-criteria-description-17 | judging-criteria-description-18 | judging-criteria-percentage-18 | judging-criteria-18 | judging-criteria-description-19 | judging-criteria-percentage-19 | judging-criteria-19 | judging-criteria-description-2 | judging-criteria-2 | judging-criteria-percentage-2 | judging-criteria-description-3 | judging-criteria-3 | judging-criteria-percentage-3 | judging-criteria-percentage-4 | judging-criteria-4 | judging-criteria-description-4 | judging-criteria-percentage-5 | judging-criteria-5 | judging-criteria-description-5 | judging-criteria-6 | judging-criteria-percentage-6 | judging-criteria-description-6 | judging-criteria-7 | judging-criteria-percentage-7 | judging-criteria-description-7 | judging-criteria-description-8 | judging-criteria-percentage-8 | judging-criteria-8 | judging-criteria-description-9 | judging-criteria-percentage-9 | judging-criteria-9 | prize-description-0 | prize-cash-amount-0 | prize-name-0 | prize-description-1 | prize-cash-amount-1 | prize-name-1 | prize-cash-amount-10 | prize-name-10 | prize-description-10 | prize-cash-amount-11 | prize-name-11 | prize-description-11 | prize-name-12 | prize-cash-amount-12 | prize-description-12 | prize-name-13 | prize-cash-amount-13 | prize-description-13 | prize-description-14 | prize-cash-amount-14 | prize-name-14 | prize-description-15 | prize-cash-amount-15 | prize-name-15 | prize-description-16 | prize-name-16 | prize-cash-amount-16 | prize-description-17 | prize-name-17 | prize-cash-amount-17 | prize-cash-amount-18 | prize-name-18 | prize-description-18 | prize-description-2 | prize-name-2 | prize-cash-amount-2 | prize-description-3 | prize-name-3 | prize-cash-amount-3 | prize-cash-amount-4 | prize-name-4 | prize-description-4 | prize-cash-amount-5 | prize-name-5 | prize-description-5 | prize-name-6 | prize-cash-amount-6 | prize-description-6 | prize-name-7 | prize-cash-amount-7 | prize-description-7 | prize-description-8 | prize-cash-amount-8 | prize-name-8 | prize-description-9 | prize-cash-amount-9 | prize-name-9 | winner-solution-description-0 | winner-solution-link-0 | winner-name-0 | winner-solution-title-0 | winner-solution-link-1 | winner-solution-description-1 | winner-name-1 | winner-solution-title-1 | winner-solution-description-2 | winner-solution-link-2 | winner-solution-title-2 | winner-name-2 | winner-solution-link-3 | winner-solution-description-3 | winner-solution-title-3 | winner-name-3 | winner-name-4 | winner-solution-title-4 | winner-solution-description-4 | winner-solution-link-4 | winner-name-5 | winner-solution-title-5 | winner-solution-link-5 | winner-solution-description-5 | winner-solution-title-6 | winner-name-6 | winner-solution-description-6 | winner-solution-link-6 | winner-solution-title-7 | winner-name-7 | winner-solution-link-7 | winner-solution-description-7 | winner-solution-description-8 | winner-solution-link-8 | winner-name-8 | winner-solution-title-8 | winner-solution-link-9 | winner-solution-description-9 | winner-name-9 | winner-solution-title-9 | memberIdeaSubmissionAllowed | showTitle | description | campaignStatusName | templateId | stageStatistics | summaryEnabled | voteCount | ideaTabEnabledForChallenge | moderatorAdminOnlyIdeasNotificationEnabled | hideCommentAuthor | authorizedGroupIds | userSubscriptionAllowed | bannerImage | groupId | showTagline | challenge-title | privateCampaign | ideaCount | memberIdeaAttachmentAllowed | authorEdit | permalink | layout |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
A full description of registration, rules, submissions, and evaluations are at the <a href="https://www.nist.gov/programs-projects/fusion-face-recognition-algorithms-2018">NIST FOFRA Support Website</a>. |
2018-11-26T07:15:48 |
false |
false |
closed |
0 |
958 |
false |
4 |
true |
Fuse the outputs of multiple face recognition algorithms to improve accuracy |
Office of Director of National Intelligence - Intelligence Advanced Research Project Activity |
false |
ideation |
08/06/2018 11:59 PM |
05/23/2018 12:00 AM |
FY18 |
$70,000 |
Dr. Chris Boehnen |
Other |
4901 |
No |
The <a href="https://www.nist.gov/programs-projects/fusion-face-recognition-algorithms-2018">NIST FOFRA Support Website</a> provides detailed instructions on participation, registration, and submissions. An overview of the FOFRA Prize Challenge, including the challenge concept and planned evaluations can be found <a href="https://s3.amazonaws.com/challenge-gov/wp-content/uploads/2018/05/nist_iarpa_frpc_2018_overview_public.pdf">here</a>. The full NIST Concept of Operations and API Specifications can be found <a href="https://s3.amazonaws.com/challenge-gov/wp-content/uploads/2018/05/iarpa_nist_fofra_2018_fusion_api.pdf">here</a>. <strong>Participation Eligibility</strong> To be eligible to win a prize under this competition, an individual or entity: <ol> <li>Must have visited the FOFRA website at Challenge.gov;</li> <li>Must have read the <a href="https://s3.amazonaws.com/challenge-gov/wp-content/uploads/2018/05/nist_iarpa_frpc_2018_overview_public.pdf">FOFRA overview slides</a>;</li> <li>Must have completed and submitted a FOFRA participation agreement form (see <a href="https://www.nist.gov/programs-projects/fusion-face-recognition-algorithms-2018">NIST FOFRA Support Website</a>);</li> <li>Must have complied with all the requirements under these rules; and</li> <li>Must be (1) an individual or team member each of whose members are 18 years of age and over, or (2) an entity incorporated.</li> </ol> The following are ineligible to participate: <ol> <li>May not be a federal entity or federal employee acting within the scope of their employment. An individual or entity shall not be deemed ineligible because the individual or entity used federal facilities or consulted with federal employees during a competition if the facilities and employees are made available to all individuals and entities participating in the competition on an equitable basis.</li> <li>Employees of IARPA, NIST, their affiliates, and/or any other individual or entity associated with the development, evaluation, or administration of the competition as well as members of such persons’ immediate families (spouses, children, siblings, parents), and persons living in the same household as such persons, whether or not related, are not eligible to participate in the competition.</li> <li><strong>Foreign Nationals & International Developers:</strong> All Developers can participate with this exception: residents of, Iran, Cuba, North Korea, Crimea Region of Ukraine, Sudan or Syria or other countries prohibited on the U.S. State Department’s State Sponsors of Terrorism list. In addition, Developers are not eligible to participate if they are on the Specially Designated National list promulgated and amended, from time to time, by the United States Department of the Treasury. It is the responsibility of the Developer to ensure that they are allowed to export their technology solution to the United States for the Live Test. Additionally, it is the responsibility of participants to ensure that no US law export control restrictions would prevent them from participating when foreign nationals are involved. If there are US export control concerns, please contact IARPA and we will attempt to make reasonable accommodations if possible. IARPA will not be held responsible for devices shipped or transported to the U.S. that are confiscated by local authorities or that violate local export laws.</li> </ol> In addition: <ol> <li>Federal grantees may not use federal funds to develop challenge applications unless consistent with the purpose of their grant award. Federal contractors may not use federal funds from a contract to develop challenge applications or to fund efforts in support of a challenge submission without written approval of both IARPA and their Federal government sponsor. Entities affiliated with the <strong>IARPA Janus program</strong> may participate, but are ineligible to win prize monies.</li> <li>Entrants must agree to assume any and all risks and waive claims against the federal government and its related entities, except in the case of willful misconduct, for any injury, death, damage, or loss of property, revenue, or profits, whether direct, indirect, or consequential, arising from their participation in a competition, whether the injury, death, damage, or loss arises through negligence or otherwise.</li> <li>Entrants must also agree to indemnify the federal government against third-party claims for damages arising from or related to competition activities. Entrants are not required to obtain liability insurance or demonstrate financial responsibility in order to participate in the competition.</li> <li>By participating in the competition, each entrant agrees to comply with and abide by these rules and the decisions of IARPA, NIST and/or the individual judges, which shall be final and binding in all respects.</li> </ol> By participating in the competition, each entrant agrees to follow all applicable local, state, federal and country of residence laws and regulations. |
No |
10/25/2018 12:00 AM |
Software and apps |
176265 |
Hosted on this platform |
Yes |
Software and apps |
A full description of registration, rules, submissions, and evaluations are at the <a href="https://www.nist.gov/programs-projects/fusion-face-recognition-algorithms-2018">NIST FOFRA Support Website</a>. |
See the NIST FOFRA Support Website for details on the challenge evaluation methodologies and criteria. |
100 |
FOFRA Prize Challenge Evaluations |
1:1 Verification accuracy gains from multi-algorithm score-level fusion. Prize value includes $2000 base award, $2000 open-source award, and $4000 workshop attendance award. |
8000 |
Verification Score-level Fusion |
1:1 Verification accuracy gains from multi-algorithm template-level fusion. Prize value includes $8000 base award, $4000 open-source award, and $4000 workshop attendance award. |
16000 |
Verification Template-level Fusion |
1:1 Identification accuracy gains from multi-algorithm score-level fusion. Prize value includes $5000 base award, $2000 open-source award, and $4000 workshop attendance award. |
Identification Score-level Fusion |
11000 |
1:1 Identification accuracy gains from two-way multi-algorithm template-level fusion. Prize value includes $10,000 base award, $4000 open-source award, and $4000 workshop attendance award. |
Identification Template-level Fusion (Two-way) |
18000 |
17000 |
Identification Template-level Fusion (Three-way) |
1:1 Identification accuracy gains from three-way multi-algorithm template-level fusion. Prize value includes $9000 base award, $4000 open-source award, and $4000 workshop attendance award. |
false |
true |
Can you leverage the data outputs of multiple face recognition algorithms to improve overall accuracy? There is a large literature on biometric fusion intended to improve accuracy via fusion of multiple modalities (e.g., face + fingerprint), multiple algorithms, or multiple samples. However, most of the research has only addressed 1:1 verification at the score-level. This prize challenge is aimed at stimulating research into methods to improve one-to-many (i.e., 1:N) identification accuracy via template-level fusion. Can further accuracy gains be realized by fusing feature-level templates or through more innovative score-level fusion methods informed by modern data science? <hr /> <strong>Who We Are: </strong>The Intelligence Advanced Research Projects Activity (IARPA), within the Office of the Director of National Intelligence (ODNI), focuses on high-risk, high-payoff research programs to tackle difficult challenges of the agencies and disciplines in the intelligence community. IARPA’s challenges invite experts from the broader research community to participate in IARPA research in a convenient, efficient, and non-contractual way. <strong>What We’re Doing: </strong>The 2018 FOFRA challenge tasks developers with fusing the outputs of multiple face recognition algorithms applied to the same input images. Fusion can be conducted on templates, before recognition, or on scores produced by recognition, with prizes awarded for best improvements to verification and identification accuracy. <strong>Why We’re Doing This: </strong>Face recognition error rates, particularly on uncontrolled face imagery, are well above zero. While algorithm development has seen considerable investment, other mechanisms for improving accuracy are known. Among them, there is a large academic literature on biometric fusion, covering multimodal and multi-algorithmic fusion. It shows that substantial accuracy gains can be made over using a single mode, or a single algorithm alone, and this can be achieved, in large part, using quite simple methods. The gains reduce when the fused inputs are correlated. The vast majority of the literature addresses biometric verification, rather than identification. Moreover, the literature covers score-level fusion rather than feature (i.e. template) level fusion. The latter, on information theoretic grounds, offers greater accuracy gains at the expense of some complexity. <strong>Where and When We’re Doing This:</strong> Registration to join the challenge will take place through Challenge.gov. You can find the challenge details and rules at that site. From the Challenge.gov webpage, participants will be directed to register with the National Institute of Standards and Technology (NIST). Registration closes on <strong><u>August 6, 2018</u></strong>. <ul> <li><strong>When does FOFRA registration begin? </strong> May 23, 2018</li> <li><strong>Where to learn more about the challenge, including rules, criteria and eligibility requirements?</strong> <ul> <li>This website</li> <li><a href="https://s3.amazonaws.com/challenge-gov/wp-content/uploads/2018/05/nist_iarpa_frpc_2018_overview_public.pdf">The FOFRA Overview document</a></li> <li><a href="https://s3.amazonaws.com/challenge-gov/wp-content/uploads/2018/05/iarpa_nist_fofra_2018_fusion_api.pdf">The FOFRA API document</a></li> </ul> </li> <li><strong>Where do participants register?</strong> <a href="https://www.nist.gov/programs-projects/fusion-face-recognition-algorithms-2018">NIST FOFRA Support Website</a></li> <li><strong>When is the deadline for comments on the API and other documents?</strong> June 6, 2018</li> <li><strong>When is the registration deadline?</strong> August 6, 2018</li> <li><strong>When will winners be announced?</strong> October 2018</li> </ul> The challenge will proceed with developers sending pre-compiled software libraries to NIST, who is the designated test laboratory for FOFRA. At NIST the algorithms will be run on sequestered images. <strong>Who Should Participate?</strong> The FOFRA Prize Challenge is intended for prize participants who are eligible to compete for the challenge prizes. We encourage researchers in the fields of biometrics, computer vision, and data science to participate, both domestic and international, from academia and industry. Other U. S. Government Agencies, Federally Funded Research and Development Centers (FFRDCs), University Affiliated Research Centers (UARCs), or any other similar organizations that have a special relationship with the Government that gives them access to privileged or proprietary information, or access to Government equipment or real property, will not be eligible to participate in the prize challenge. Entities affiliated with the IARPA Janus program may participate, but are ineligible to win prize monies. <strong>Why Participate: </strong>The developers of the fusion methods with the greatest improvements in match accuracy will be eligible to win cash prizes from a total prize purse of $70,000. Prizes will be awarded in four categories: template- and score-level fusion applied to verification and identification, with extra awards to winners who opt to open-source their approaches. <strong>Related Links:</strong> <ul> <li><a href="https://www.iarpa.gov/index.php/research-programs/janus">IARPA Janus Program</a></li> <li><a href="https://www.nist.gov/programs-projects/face-recognition-vendor-test-frvt">NIST Face Recognition Vendor Test</a></li> </ul> For general questions: <a href="mailto:[email protected]">[email protected]</a> For technical questions: <a href="mailto:[email protected]">[email protected]</a> |
Launched |
0 |
false |
0 |
true |
false |
false |
false |
269 |
true |
Fusion of Face Recognition Algorithms |
true |
0 |
false |
false |
/challenge/fusion-of-face-recognition-algorithms/ |
json-page |