<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div id="appendonsend"></div>
<div id="divRplyFwdMsg">
<div style="direction: ltr;" class="elementToProof"> </div>
</div>
<div style="background-color: rgb(255, 255, 255); margin: 0px;">
<div style="background-color: rgb(255, 255, 255); margin: 0px;">
<table style="width: 100%; box-sizing: border-box; border-collapse: collapse; border-spacing: 0px;" data-e2ma-color="#e64626, #000000, #3f7ab9, #eeeeee" cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td style="vertical-align: top;" align="center">
<table style="width: 640px; box-sizing: border-box; border-collapse: collapse; border-spacing: 0px;" cellpadding="0" cellspacing="0" id="x_template_container">
<tbody>
<tr>
<td style="vertical-align: top;" align="left">
<table style="width: 640px; box-sizing: border-box; border-collapse: collapse; border-spacing: 0px;" cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td style="background-color: rgb(230, 70, 38); padding: 25px; vertical-align: top;" align="center">
<table style="width: 100%; box-sizing: border-box; border-collapse: collapse; border-spacing: 0px;" cellpadding="0" cellspacing="0" align="center">
<tbody>
<tr>
<td>
<table style="width: 100%; box-sizing: border-box; border-collapse: collapse; border-spacing: 0px;" cellpadding="0" cellspacing="0" align="center">
<tbody>
<tr>
<td>
<div style="text-align: left; font-family: Arial, Helvetica, sans-serif; font-size: 14px;">
School of History and Philosophy of Science</div>
<div style="text-align: left; font-family: Arial, Helvetica, sans-serif; font-size: 20px;">
<b>RESEARCH SEMINAR</b></div>
</td>
</tr>
</tbody>
</table>
</td>
<td style="width: 150px;" align="center">
<div style="font-family: Arial, Helvetica, sans-serif; font-size: 12px;"><img style="width: 150px; height: 52px;" height="52" width="150" alt="The University of Sydney" src="https://d31hzlhk6di2h5.cloudfront.net/20250909/8c/9b/e0/27/9f98e4c779985cb365ac9f5d_300x104.png"></div>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
<tr>
<td style="background-color: rgb(255, 255, 255); vertical-align: top;" align="left">
<table style="width: 100%; box-sizing: border-box; border-collapse: collapse; border-spacing: 0px;" cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td>
<table style="width: 100%; box-sizing: border-box; border-collapse: collapse; border-spacing: 0px;" cellpadding="0" cellspacing="0" id="x_block_wctettng">
<tbody>
<tr>
<td style="vertical-align: top;">
<table style="width: 100%; box-sizing: border-box; border-collapse: collapse; border-spacing: 0px;" cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td style="padding: 1px; vertical-align: top;">
<table style="box-sizing: border-box; border-collapse: collapse; border-spacing: 0px;" cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td style="vertical-align: top;">
<table style="box-sizing: border-box; border-collapse: collapse; border-spacing: 0px;" cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td style="text-align: center; vertical-align: top;"><span style="font-family: Arial, Helvetica, sans-serif; font-size: 12px;"><img style="width: 638px; height: 425px; display: block;" height="425" width="638" src="https://d31hzlhk6di2h5.cloudfront.net/20250909/31/8c/47/4b/1bf63ffa65bd451410b1837c_1276x850.jpg"></span></td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
<table style="width: 100%; box-sizing: border-box; border-collapse: collapse; border-spacing: 0px;" cellpadding="0" cellspacing="0" id="x_block_hdiqhzfz">
<tbody>
<tr>
<td style="line-height: 1.5; vertical-align: top;">
<table style="line-height: 1.5; width: 100%; box-sizing: border-box; border-collapse: collapse; border-spacing: 0px;" cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td style="line-height: 1.5; padding: 20px; vertical-align: top;">
<h1 style="text-align: center; line-height: 1.2; margin: 0px; display: block; font-family: Arial, Helvetica, sans-serif; font-size: 18px; color: rgb(230, 70, 38);">
If peer review is broken, what can fix it? Some suggestions from the repliCATS project (Collaborative Assessments for Trustworthy Science).<br>
<span style="font-size: 15px; color: rgb(0, 0, 0);">Fiona Fidler (University of Melbourne)</span><br>
<br>
</h1>
<div style="text-align: left; line-height: 21px; margin-bottom: 10px; display: block; font-family: Arial, Helvetica, sans-serif; font-size: 14px; color: rgb(51, 51, 51);">
<b>Dates: </b>Monday, 15/9/2025<br>
<b>Start Time: </b>5:00pm <b>(Note:</b> Seminar start time is at 5:00pm<b>) </b><br>
<b>Venue: </b>F23.501. Michael Spence Building, Level 5, Room 501<br>
<b>How to register: </b>Free, no registration required</div>
<div style="text-align: left; line-height: 21px; margin-bottom: 10px; display: block; font-family: Arial, Helvetica, sans-serif; font-size: 14px;">
<span style="color: rgb(51, 51, 51);"><b>Website: </b></span><span style="color: rgb(63, 122, 185);"><u><a style="color: rgb(63, 122, 185);" data-type="url" data-name="HPS Event" data-auth="NotApplicable" class="OWAAutoLink" id="OWAd200515c-bd9e-db75-ec19-7236647355f1" href="https://url.au.m.mimecastprotect.com/s/gKKxC3QNPBi21nrv1sOH3tQDtSR?domain=t.e2ma.net">https://hps-events.sydney.edu.au/</a></u></span></div>
<div style="text-align: left; line-height: 21px; margin-bottom: 10px; display: block; font-family: Arial, Helvetica, sans-serif; font-size: 14px; color: rgb(51, 51, 51);">
<br>
</div>
<div style="text-align: justify; line-height: 1.5; margin-bottom: 10px; display: block; font-family: Arial, Helvetica, sans-serif; font-size: 14px; color: rgb(51, 51, 51);">
<b>Abstract:</b> In many scientific fields, post-publication surveys of the literature find that peer reviewers routinely overlook methodological flaws and statistical errors, avoid reporting suspected instances of fraud, and commonly reach a level of agreement
barely exceeding what would be expected by chance. Other studies expose the extent of gender bias in peer review, and questionable editorial protocols that lack transparency. Anecdotally, editors also report increasingly difficulty in recruiting reviewers.
What can be done about these well-known problems? This talk proposes an alternative model of peer review, drawing from expert elicitation, deliberation and decision-making literature and our experience running the repliCATS project. There is perhaps a limited
role for AI in an overhaul of peer review, but that is not the focus of the talk.<br>
<br>
Now in its seventh year, the repliCATS project has evaluated over 4,000 published social science articles across 8 disciplines, including psychology, economics, and education, as well as hundreds of preprints on PsyArXiv. For each paper, a diverse group of
experts discuss and forecast the likely replicability of the research findings and make a variety of other judgements about the credibility of the evidence presented using a structured deliberation protocol. This talk will present our approach to evaluating
research, and for cases where we have the outcome of actual replication studies, data about the accuracy of our forecasts. <br>
<br>
<br>
<b>Bio</b>: <b>Fiona Fidler </b>is Professor and Head of the History & Philosophy of Science (HPS) Program at the University of Melbourne. She is broadly interested in how experts, especially scientists, make decisions and change their minds. Her past research
has examined how methodological change occurs in different disciplines, including psychology, medicine and ecology. She is also interested in methods for eliciting reliable expert judgements to improve decision making, including peer review decisions. She
has been active in establishing the Metascience community in Australia, and was the founding president of the Association for Interdisciplinary Metaresearch and Open Science (AIMOS). She is co-director of the MetaMelb Research Initiative at the University
of Melbourne, and lead PI of the repliCATS project (Collaborative Assessments for Trustworthy Science). </div>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
<table style="width: 100%; box-sizing: border-box; border-collapse: collapse; border-spacing: 0px;" cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td data-e2ma-styles="background, border-left, border-right"></td>
</tr>
</tbody>
</table>
<table style="width: 100%; box-sizing: border-box; border-collapse: collapse; border-spacing: 0px;" cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td>
<table style="width: 100%; box-sizing: border-box; border-collapse: collapse; border-spacing: 0px;" cellpadding="0" cellspacing="0" id="x_block_dugjdpgf">
<tbody>
<tr>
<td style="line-height: 1.5; vertical-align: top;">
<table style="line-height: 1.5; width: 100%; box-sizing: border-box; border-collapse: collapse; border-spacing: 0px;" cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td style="line-height: 1.5; vertical-align: top;">
<div style="line-height: 1.5; margin-bottom: 10px; display: block; font-family: Arial, Helvetica, sans-serif; font-size: 14px; color: rgb(51, 51, 51);">
<br>
</div>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
<tr>
<td style="background-color: rgb(230, 70, 38); vertical-align: top;" align="left">
<table style="width: 100%; box-sizing: border-box; border-collapse: collapse; border-spacing: 0px;" cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td>
<table style="width: 100%; box-sizing: border-box; border-collapse: collapse; border-spacing: 0px;" cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td style="width: 30px;"><span style="font-family: Arial, Helvetica, sans-serif; font-size: 12px;"><img style="width: 30px; height: 30px; display: block;" height="30" width="30" src="https://images.e2ma.net/0/images/templates/spacer.gif"></span></td>
<td style="line-height: 0px; background-color: rgb(0, 0, 0); width: 2px;"><span style="font-family: Arial, Helvetica, sans-serif; font-size: 0px;"><img style="width: 2px; height: 30px; display: block;" height="30" width="2" src="https://images.e2ma.net/0/images/templates/spacer.gif"></span></td>
<td>
<div style="font-family: Arial, Helvetica, sans-serif; font-size: 12px;"> </div>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
<tr>
<td style="padding-top: 15px; padding-bottom: 40px;">
<table style="width: 100%; box-sizing: border-box; border-collapse: collapse; border-spacing: 0px;" cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td style="width: 30px;">
<div style="font-family: Arial, Helvetica, sans-serif; font-size: 12px;"> </div>
</td>
<td style="vertical-align: top; width: 150px;">
<table style="width: 100%; box-sizing: border-box; border-collapse: collapse; border-spacing: 0px;" cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td align="center">
<div style="font-family: Arial, Helvetica, sans-serif; font-size: 12px;"><img style="width: 150px; height: 52px; display: block;" height="52" width="150" alt="The University of Sydney" src="https://d31hzlhk6di2h5.cloudfront.net/20250909/8c/9b/e0/27/9f98e4c779985cb365ac9f5d_300x104.png"></div>
</td>
</tr>
<tr>
<td style="padding-top: 20px; vertical-align: bottom;" align="left">
<table style="width: 100%; box-sizing: border-box; border-collapse: collapse; border-spacing: 0px;" cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td style="text-align: left; line-height: 160%; color: rgb(0, 0, 0);">
<div style="text-align: left; line-height: 160%; font-family: Arial, sans-serif; font-size: 11px;">
Keep in touch</div>
</td>
</tr>
<tr>
<td style="padding-top: 8px;" align="center">
<table style="width: 150px; box-sizing: border-box; border-collapse: collapse; border-spacing: 0px;" cellpadding="0" cellspacing="0" align="center">
<tbody>
<tr>
<td>
<div style="font-family: Arial, Helvetica, sans-serif; font-size: 12px; color: rgb(63, 122, 185);">
<u><a style="color: rgb(63, 122, 185);" data-auth="NotApplicable" class="OWAAutoLink" id="OWA06bb00e0-9727-8776-f792-e3b8929e5fcb" href="https://url.au.m.mimecastprotect.com/s/IxwsC4QOPEilNXwxNFXIZt4hrWF?domain=t.e2ma.net"><img style="width: 18px; height: 15px;" height="15" width="18" alt="Facebook" src="https://d31hzlhk6di2h5.cloudfront.net/20250909/c0/6b/cc/93/475be56800c37143b2dc1d93_36x30.png"></a></u></div>
</td>
<td>
<div style="font-family: Arial, Helvetica, sans-serif; font-size: 12px; color: rgb(63, 122, 185);">
<u><a style="color: rgb(63, 122, 185);" data-auth="NotApplicable" class="OWAAutoLink" id="OWA83b3ee7b-4a9c-24b4-58e8-a015b1e2d185" href="https://url.au.m.mimecastprotect.com/s/Y6qkC5QPXJi6mBr1mCjSKtkFdxp?domain=t.e2ma.net"><img style="width: 18px; height: 15px;" height="15" width="18" alt="Twitter" src="https://d31hzlhk6di2h5.cloudfront.net/20250909/11/f9/d6/e3/286d5ce938f1405a89ed1c98_36x30.png"></a></u></div>
</td>
<td>
<div style="font-family: Arial, Helvetica, sans-serif; font-size: 12px; color: rgb(63, 122, 185);">
<u><a style="color: rgb(63, 122, 185);" data-auth="NotApplicable" class="OWAAutoLink" id="OWA848a7743-f9dc-9b62-9fab-fa9e5e012730" href="https://url.au.m.mimecastprotect.com/s/Svl8C6XQ4Lfy254J2IlTDt58nRS?domain=t.e2ma.net"><img style="width: 17px; height: 15px;" height="15" width="17" alt="Instagram" src="https://d31hzlhk6di2h5.cloudfront.net/20250909/07/6b/c2/9f/30542dfab3087119743e8d49_34x30.png"></a></u></div>
</td>
<td>
<div style="font-family: Arial, Helvetica, sans-serif; font-size: 12px; color: rgb(63, 122, 185);">
<u><a style="color: rgb(63, 122, 185);" data-auth="NotApplicable" class="OWAAutoLink" id="OWAb505b7eb-a51f-311d-dded-4719209d2dfa" href="https://url.au.m.mimecastprotect.com/s/C6_ZC71R2NTZ5DBY5uEUBtoCmFy?domain=t.e2ma.net"><img style="width: 18px; height: 14px;" height="14" width="18" alt="LinkedIn" src="https://d31hzlhk6di2h5.cloudfront.net/20250909/a7/84/9e/85/bfccb3578fc999d3d6077b60_36x28.png"></a></u></div>
</td>
<td>
<div style="font-family: Arial, Helvetica, sans-serif; font-size: 12px; color: rgb(63, 122, 185);">
<u><a style="color: rgb(63, 122, 185);" data-auth="NotApplicable" class="OWAAutoLink" id="OWA4563be7f-997c-08b4-15b9-d74dd5c94470" href="https://url.au.m.mimecastprotect.com/s/WmBhC81V0PTYVoygVIgclty9vWS?domain=t.e2ma.net"><img style="width: 20px; height: 15px;" height="15" width="20" alt="YouTube" src="https://d31hzlhk6di2h5.cloudfront.net/20250909/99/05/83/95/ba6602527f8be6bbdaba9d3f_40x30.png"></a></u></div>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
</td>
<td style="vertical-align: top;">
<table style="width: 100%; box-sizing: border-box; border-collapse: collapse; border-spacing: 0px;" cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td style="text-align: left; line-height: 160%; padding-left: 50px; color: rgb(0, 0, 0);">
<div style="text-align: left; line-height: 160%; font-family: Arial, sans-serif; font-size: 11px;">
Copyright © 2025 The University of Sydney, NSW 2006 Australia<br>
Phone +61 2 9351 2222 ABN 15 211 513 464 CRICOS Number: 00026A<br>
<br>
Please add hps.admin@sydney.edu.au to your address book or senders safe list to make sure you continue to see our emails in the future.<br>
<br>
<span style="color: rgb(0, 0, 0);"><u><a style="color: rgb(0, 0, 0);" data-type="url" data-name="Manage" data-auth="NotApplicable" class="OWAAutoLink" id="OWAdac1de8e-7b7e-7dd2-df90-a75d7efb3f72" href="https://url.au.m.mimecastprotect.com/s/LndJCZY1NqiQZJWYZhPuvtBEAeH?domain=app.e2ma.net">Manage</a></u></span> your
preferences | <span style="color: rgb(0, 0, 0);"><u><a style="color: rgb(0, 0, 0);" data-type="url" data-name="Opt out" data-auth="NotApplicable" class="OWAAutoLink" id="OWAd28fa9f7-c83f-e3f3-f788-5c01dc3c5bcf" href="https://url.au.m.mimecastprotect.com/s/-tKuC1WLPxcqyVQXyhyCYtVNqpX?domain=t.e2ma.net">Opt
out</a></u></span> using TrueRemove®<br>
Got this as a forward? <span style="color: rgb(0, 0, 0);"><u><a style="color: rgb(0, 0, 0);" data-type="url" data-name="Sign up" data-auth="NotApplicable" class="OWAAutoLink" id="OWAa0049c9b-7caa-e99e-f2f6-89150bb25eb9" href="https://url.au.m.mimecastprotect.com/s/521hC2xMQzi8qMDQqf0F5t5EGus?domain=app.e2ma.net/">Sign
up</a></u></span> to receive our future emails.<br>
View this email <span style="color: rgb(0, 0, 0);"><u><a style="color: rgb(0, 0, 0);" data-type="url" data-name="online" data-auth="NotApplicable" class="OWAAutoLink" id="OWA28a59ffe-3f0c-06f2-dedb-1ae5d9ff327a" href="https://url.au.m.mimecastprotect.com/s/2WFoCROND2u5923X9I9fyt1Unpo?domain=t.e2ma.net">online</a></u></span>.</div>
<div style="text-align: left; line-height: 160%; font-family: Arial, sans-serif; font-size: 11px;">
<br>
</div>
<div style="text-align: left; line-height: 160%; font-family: Arial, sans-serif; font-size: 11px;">
<span style="color: rgb(0, 0, 0);"><u><a style="color: rgb(0, 0, 0);" data-type="url" data-name="Disclaimer" data-auth="NotApplicable" class="OWAAutoLink" id="OWAc6289f4d-6054-a536-5be8-f73d2024bf21" href="https://url.au.m.mimecastprotect.com/s/YUKzC91WPRT2yGwjysKfEtqCnyW?domain=t.e2ma.net">Disclaimer</a></u></span> |
<span style="color: rgb(0, 0, 0);"><u><a style="color: rgb(0, 0, 0);" data-type="url" data-name="Privacy statement" data-auth="NotApplicable" class="OWAAutoLink" id="OWA00051980-f95c-27d3-c887-a53f15fc4e11" href="https://url.au.m.mimecastprotect.com/s/2gKcC0YKPvimO1AzOuRh4t9eeMs?domain=t.e2ma.net">Privacy
statement</a></u></span> | <span style="color: rgb(0, 0, 0);"><u><a style="color: rgb(0, 0, 0);" data-type="url" data-name="University of Sydney" data-auth="NotApplicable" class="OWAAutoLink" id="OWAb72c4a76-5731-b45a-75f1-acc474e94150" href="https://url.au.m.mimecastprotect.com/s/4sKtCgZ0N1iGXMzJXhYizt4jYmn?domain=t.e2ma.net">University
of Sydney</a></u></span></div>
</td>
</tr>
</tbody>
</table>
</td>
<td style="vertical-align: bottom; width: 30px;">
<table style="width: 100%; box-sizing: border-box; border-collapse: collapse; border-spacing: 0px;" cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td style="line-height: 0px; background-color: rgb(255, 255, 255); height: 2px;">
<span style="font-family: Arial, Helvetica, sans-serif; font-size: 0px;"><img style="width: 1px; height: 2px; display: block;" height="2" width="1" src="https://images.e2ma.net/0/images/templates/spacer.gif"></span></td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
</div>
<div><img style="width: 1px; height: 1px;" height="1" width="1" src="https://t.e2ma.net/track/g68j3x/8zmgipmb"></div>
</div>
</body>
</html>