Claims and Challenges in Evaluating Human-Level Intelligent Systems on Vimeo

See all Show me

120. Automated Program Learning for AGI: Part 2 / 2

by Jeriaska

3 months ago

119. Automated Program Learning for AGI: Part 1 / 2

by Jeriaska

3 months ago

118. Bootstrap Dialog: A Conversational English Text Pa…

by Jeriaska

3 months ago

117. Program Representation for General Intelligence

by Jeriaska

3 months ago

116. Integrating Reasoning and Action through Simulation

by Jeriaska

4 months ago

115. Economic Attention Networks:Associative Memory an…

by Jeriaska

4 months ago

114. Here Comes a New Challenger II Turbo Promo Video

by Jeriaska

4 months ago

113. A Cognitive Map for an Artificial Agent

by Jeriaska

5 months ago

112. Embodiment: Does a laptop have a body?

by Jeriaska

5 months ago

111. Cognitive Model Comparisons: The Road to AGI?

by Jeriaska

5 months ago

110. Everyone's a Critic: Memory Models and Uses for an…

by Jeriaska

5 months ago

109. Nobuoooo 6.09: Trash Panic

by Jeriaska

5 months ago

108. What Is AGI? Clarifying The Goal For Engineering A…

by Jeriaska

5 months ago

107. Claims and Challenges in Evaluating Human-Level In…

by Jeriaska

6 months ago

106. The Beatles: Rock Band - Harmonix E3 Demo

by Jeriaska

6 months ago

105. Creating a Cooperative Future (Part Three)

by Jeriaska

6 months ago

104. Nobuooo 5.09: Monsters Deluxe

by Jeriaska

6 months ago

103. Nobuooo 4.09: GDC Mosaic

by Jeriaska

7 months ago

102. L'ombre de Tenchu

by Jeriaska

7 months ago

101. Nobuooo 3.09: Shadow of Tenchu

by Jeriaska

7 months ago

100. Creating a Cooperative Future (Part Two)

by Jeriaska

8 months ago

99. Nobuooo 2.09: The Story of Mega Ran 9

by Jeriaska

8 months ago

98. Nobuooo Video: EXTRA '08 (HD)

by Jeriaska

8 months ago

97. Nobuooo 1.09: The Perfect High

by Jeriaska

8 months ago

96. Creating a Cooperative Future (Part One)

by Jeriaska

8 months ago

95. Intro to AGI-09

by Jeriaska

8 months ago

94. Unethical but Rule-Bound Robots Would Kill Us All

by Jeriaska

8 months ago

The paper on which this AGI-09 presentation by John Laird is based represents a first step in attempting to engage the research community in discussions about evaluation of human-level intelligent systems. First, we discuss the challenges of evaluating human-level intelligent systems.

Second, we explore the different types of claims that are
made about HLI systems, which are the basis for
confirmatory evaluations. Finally, we briefly discuss a range of experimental designs that support the evaluation of claims.

John E. Laird, Robert E. Wray III, Robert P. Marinier III, Pat Langley

Division of Computer Science and Engineering, University of Michigan