menu_book Explore the article's raw data

SummEval: Re-evaluating Summarization Evaluation

Abstract

The scarcity of comprehensive up-to-date studies on evaluationmetrics for text summarization and the lack of consensus regarding evaluation protocols continue to inhibit progress. We address the existing shortcomings of summarization evaluation methods along five dimensions: 1) we re-evaluate 14 automatic evaluation metrics in a comprehensive and consistent fashion using neural summarization model outputs along with expert and crowd-sourced human annotations; 2) we consistently benchmark 23 recent summarization models using the aforementioned automatic evaluation metrics; 3) we assemble the largest collection of summaries generated by models trained on the CNN/DailyMail news dataset and share it in a unified format; 4) we implement and share a toolkit that provides an extensible and unified API for evaluating summarization models across a broad range of automatic metrics; and 5) we assemble and share the largest and most diverse, in terms of model types, collection of human judgments of model-generated summaries on the CNN/Daily Mail dataset annotated by both expert judges and crowd-sourceworkers. We hope that this work will help promote a more complete evaluation protocol for text summarization as well as advance research in developing evaluation metrics that better correlate with human judgments.

article Article

date_range 2021

language English

link Link of the paper

format_quote

Fabbri Alexander

Kryscinski Wojciech

Mccann Bryan

Xiong Caiming

Socher Richard

Radev Dragomir

Sorry! There is no raw data available for this article.

Loading references...

Loading citations...

shopping_basket PURCHASE DATA

Assessment of reinforced concrete building damages following the Kahramanmaraş earthquakes in Malatya, Turkey (February 6, 2023)

Abstract

Earthquakes of magnitude Mw = 7.7 and Mw = 7.6 hit the city of Kahramanmaraş (Turkey) on 6 February 2023. These earthquakes caused serious damage in 11 provinces in Turkey resulting in over 50,000 deaths and huge economic losses with the collapse of thousands of buildings. Two consecutive devastating earthquakes have severely damaged the reinforced concrete building stock located in Malatya. There are many reasons reinforced concrete structures suffer damage under the influence of seismic loads. These reasons can be listed as material and section properties that do not comply with earthquake codes, workmanship defects, ground parameters that are not considered and design errors, as seen in field investigations after earthquakes in Turkey in the past. In this research, a field study was conducted on reinforced concrete buildings damaged after the earthquakes in Malatya province. The causes of structural damages in reinforced concrete buildings between 6–26 years of age were assessed in terms of design and material defects. The structural damages were mainly caused due to insufficient stirrups in structural members, short column, strong beam–weak column, failures of infill walls, soft story type collapse, poor concrete quality, and reinforcement corrosion. In addition to the field investigation, the spectrum relationships created using raw acceleration data obtained from DEMP (Disaster and Emergency Management Presidency) stations in Malatya province were compared with the design response spectra.

article Article

date_range 2024

language English

link Link of the paper

Collapsed buildings

Example 1 (jpg)