Complex Event Analysis - Report

Key Focus

  • a member of a team of ordinary people who make surprisingly accurate predictions for the forecasting firm Good Judgment, Inc In recent months, businesses, governments and other institutions have worked with superforecasters like Roth to help them understand how the COVID-19 outbreak might unfold.
    That a group of semi-professional forecasters would somehow have accurate insight into anything as complex and important as the coronavirus pandemic sounds like the stuff of science fiction, or even ancient history.like the seers of old who told fortunes to kings and nobles
  • And Philip Tetlock, a professor at the University of Pennsylvania and a co-founder of Good Judgment, acknowledges that there are times in which expertise is crucial (for example, he notes that some public health experts warned about the possibility of a coronavirus pandemic early in the outbreak.)
    However, Tetlock argues that superforecasters have skills that experts may not: for example, they may also be more flexible than traditional scientists, because they're not bound to a particular discipline or approach
  • Momentum supporting factors

  • (good_judgment, outbreak, superforecasters)
  • (outbreak, superforecasters)
  • (governments, superforecasters)
  • (coronavirus, superforecasters)
  • (coronavirus, good_judgment, superforecasters)
  • (covid-19, semi-professional)
  • (good_judgment, semi-professional, superforecasters)
  • (covid-19, seers)
  • (good_judgment, seers, superforecasters)
  • (covid-19, superforecasters)
  • Challenge supporting factors

  • (experts, vet)
  • Work-in-progress supporting factors

  • (good_judgment, outbreak, superforecasters)
  • (experts, superforecasters)
  • (experts, good_judgment, superforecasters)
  • (good_judgment_open, superforecasters)
  • (coronavirus, good_judgment, superforecasters)
  • (experts, tetlock)
  • (good_judgment, superforecasters, university)
  • (covid-19, virus)
  • (superforecasters, university)
  • (good_judgment, superforecasters, tetlock)
  • Complex Event Time Series Summary - REPORT


    Time PeriodChallengeMomentumWIP
    Report2.94 30.88 66.18

    High Level Abstraction (HLA) combined

    High Level Abstraction (HLA)Report
    (1) (good_judgment,outbreak,superforecasters)100.00
    (2) (coronavirus,good_judgment,superforecasters)78.57
    (3) (outbreak,superforecasters)46.94
    (4) (experts,superforecasters)45.92
    (5) (experts,good_judgment,superforecasters)44.90
    (6) (governments,superforecasters)41.84
    (7) (coronavirus,superforecasters)41.84
    (8) (good_judgment_open,superforecasters)37.76
    (9) (experts,tetlock)34.69
    (10) (good_judgment,superforecasters,university)33.67
    (11) (covid-19,virus)33.67
    (12) (superforecasters,university)31.63
    (13) (good_judgment,superforecasters,tetlock)29.59
    (14) (covid-19,superforecasters)27.55
    (15) (superforecasters,tetlock)26.53
    (16) (covid-19,semi-professional)25.51
    (17) (good_judgment,semi-professional,superforecasters)24.49
    (18) (covid-19,seers)23.47
    (19) (good_judgment,seers,superforecasters)22.45
    (20) (experts,virus)15.31
    (21) (covid-19,vaccine)12.24
    (22) (crisis,experts)11.22
    (23) (covid-19,unpredictably)9.18
    (24) (experts,unpredictably)8.16
    (25) (covid-19,shannon_gifford)7.14
    (26) (covid-19,experts)3.06
    (27) (experts,warning)2.04
    (28) (experts,vet)1.02

    Complex Event Analysis - REPORT

    Back to top of page

    Supporting narratives:

    • momentum (Read more)
      • a member of a team of ordinary people who make surprisingly accurate predictions for the forecasting firm Good Judgment, Inc In recent months, businesses, governments and other institutions have worked with superforecasters like Roth to help them understand how the COVID-19 outbreak might unfold.
        That a group of semi-professional forecasters would somehow have accurate insight into anything as complex and important as the coronavirus pandemic sounds like the stuff of science fiction, or even ancient history.like the seers of old who told fortunes to kings and nobles
      • High Level Abstractions:
        • (covid-19,semi-professional)
        • (covid-19,superforecasters)
        • (good_judgment,semi-professional,superforecasters)
        • (good_judgment,outbreak,superforecasters)
        • (coronavirus,good_judgment,superforecasters)
        • (outbreak,superforecasters)
        • (coronavirus,superforecasters)
        • (governments,superforecasters)
        • Inferred entity relationships (3)
        • (good_judgment,superforecasters,tetlock) [inferred]
        • (outbreak,superforecasters) [inferred]
        • (good_judgment,superforecasters,university) [inferred]

    • momentum (Read more)
      • a member of a team of ordinary people who make surprisingly accurate predictions for the forecasting firm Good Judgment, Inc In recent months, businesses, governments and other institutions have worked with superforecasters like Roth to help them understand how the COVID-19 outbreak might unfold.
        That a group of semi-professional forecasters would somehow have accurate insight into anything as complex and important as the coronavirus pandemic sounds like the stuff of science fiction, or even ancient history.like the seers of old who told fortunes to kings and nobles.
      • High Level Abstractions:
        • (good_judgment,seers,superforecasters)
        • (covid-19,seers)

    • momentum (Read more)
      • "But when the herd turns into human beings who make decisions to comply or not comply with different guidelines, and when governments set policies about stay home or not at home, or keep schools open or not, when all of those different factors get involved, that's where a group of human forecasters really excels."
        Jackson agrees that it's possible superforecasters could better predict or accommodate for events like mass protests compared to typical viral modeling approaches
      • High Level Abstractions:
        • (governments,superforecasters)

    • momentum (Read more)
      • "Talented amateurs who pay attention to both the science and the news seem to be better at putting accurate probabilities on key outcomes in this phase of the crisis," he says. "The experts were really good at warning us about the fundamental danger, but they may be less adept at adapting nimbly to the dynamics about this phase of the crisis."
        Superforecasters aren't just smart, Tetlock says; they also tend to be actively open-minded and curious
      • High Level Abstractions:
        • (crisis,experts)
        • (experts,warning)

    • challenge (Read more)
      • Michael Jackson, an associate scientific investigator at Kaiser Permanente Washington Health Research Institute, cautions that superforecasters are a "black box," meaning their less-than-scientific methods make it impossible to vet their work in the same way that a scientist's output would undergo peer review.
      • High Level Abstractions:
        • (experts,vet)

    • WIP (Read more)
      • And Philip Tetlock, a professor at the University of Pennsylvania and a co-founder of Good Judgment, acknowledges that there are times in which expertise is crucial (for example, he notes that some public health experts warned about the possibility of a coronavirus pandemic early in the outbreak.)
        However, Tetlock argues that superforecasters have skills that experts may not: for example, they may also be more flexible than traditional scientists, because they're not bound to a particular discipline or approach
      • High Level Abstractions:
        • (good_judgment,superforecasters,university)
        • (superforecasters,university)
        • (experts,superforecasters)
        • (experts,good_judgment,superforecasters)
        • (good_judgment,outbreak,superforecasters)
        • (experts,tetlock)
        • (coronavirus,good_judgment,superforecasters)
        • (good_judgment,superforecasters,tetlock)
        • (superforecasters,tetlock)
        • Inferred entity relationships (5)
        • (good_judgment,superforecasters,tetlock) [inferred]
        • (superforecasters,tetlock) [inferred]
        • (superforecasters,university) [inferred]
        • (outbreak,superforecasters) [inferred]
        • (good_judgment,superforecasters,university) [inferred]

    • WIP (Read more)
      • The company's superforecasters undergo years of testing before they're brought onto the team.in the early days, through tournaments sponsored by the Intelligence Advanced Research Projects Activity, and now on the open-to-the-public forecasting site Good Judgment Open.
      • High Level Abstractions:
        • (good_judgment_open,superforecasters)

    • WIP (Read more)
      • Under the current model, the best forecasters on Good Judgment Open are invited to an online community of superforecasters, where they can share ideas and contribute their predictions to a system that aggregates their forecasts
      • High Level Abstractions:
        • (good_judgment_open,superforecasters)

    • WIP (Read more)
      • LAW
        UPDATED: JUNE 11, 2020 4:17 EDT | ORIGINALLY PUBLISHED: JUNE 11, 2020 2:59 EDT
        When Dr. Anthony Fauci said in late May that there's a "good chance" a COVID-19 vaccine will be ready by the end of this year, Steve Roth badly wanted to believe him. Roth, a 74-year-old New Yorker who endured fever, pneumonia and anxiety while fighting the virus, wants life to go back to normal as much as anyone.
      • High Level Abstractions:
        • (covid-19,virus)

    • WIP (Read more)
      • Shannon Gifford, a 61-year-old who has been forecasting for more than eight years and is the deputy chief projects officer for the Denver, Colorado mayor's office, says her colleagues were taken aback when she nudged them as early as January to consider how COVID-19 could affect the city.
        "I remember saying in large meetings, 'Well, whatever's happening in a couple months could be very different if this virus crashes the economy,'" says Gifford.
      • High Level Abstractions:
        • (covid-19,virus)
        • (experts,virus)

    • WIP (Read more)
      • "It's very much driven by human behaviors, and we've seen that those can change abruptly and unpredictably even in just the short course of this pandemic so far."
        Furthermore, superforecasters can assist experts in sounding the alarm early in a major crisis.which, in the case of COVID-19, can save lives
      • High Level Abstractions:
        • (covid-19,superforecasters)
        • (covid-19,unpredictably)
        • (experts,unpredictably)

    • WIP (Read more)
      • LAW
        UPDATED: JUNE 11, 2020 4:17 EDT | ORIGINALLY PUBLISHED: JUNE 11, 2020 2:59 EDT
        When Dr. Anthony Fauci said in late May that there's a "good chance" a COVID-19 vaccine will be ready by the end of this year, Steve Roth badly wanted to believe him. Roth, a 74-year-old New Yorker who endured fever, pneumonia and anxiety while fighting the virus, wants life to go back to normal as much as anyone
      • High Level Abstractions:
        • (covid-19,vaccine)
        • Inferred entity relationships (2)
        • (covid-19,vaccine,wuhan) [inferred]
        • (covid-19,vaccine,zaks) [inferred]

    • WIP (Read more)
      • "It's very much driven by human behaviors, and we've seen that those can change abruptly and unpredictably even in just the short course of this pandemic so far."
        Furthermore, superforecasters can assist experts in sounding the alarm early in a major crisis.which, in the case of COVID-19, can save lives. Shannon Gifford, a 61-year-old who has been forecasting for more than eight years and is the deputy chief projects officer for the Denver, Colorado mayor's office, says her colleagues were taken aback when she nudged them as early as January to consider how COVID-19 could affect the city.
        "I remember saying in large meetings, 'Well, whatever's happening in a couple months could be very different if this virus crashes the economy,'" says Gifford
      • High Level Abstractions:
        • (crisis,experts)
        • (covid-19,shannon_gifford)
        • (covid-19,experts)

    • WIP (Read more)
      • "The experts were really good at warning us about the fundamental danger, but they may be less adept at adapting nimbly to the dynamics about this phase of the crisis."
        Superforecasters aren't just smart, Tetlock says; they also tend to be actively open-minded and curious.
      • High Level Abstractions:
        • (experts,tetlock)

    Target rule match count: 30.0 Challenge: 0.01 Momentum: 0.15 WIP: 0.33