A Novel Sample Selection Strategy for Imbalanced Data of Biomedical Event Extraction with Joint Scoring Mechanism

Table 8

Comparison with other systems on GE’11 test set.

System		Event class
		SVT	BIND	REG	ALL
FAUST	W	68.47 80.25/73.90	44.20/53.71/48.49	38.02/54.94/44.94	49.41/64.75/56.04
	A	66.16/81.04/72.85	45.53/58.09/51.05	39.38/58.18/46.97	50.00/67.53/57.46
	F	75.58/78.23/76.88	40.97/44.70/42.75	34.99/48.24/40.56	47.92/58.47/52.67
UMass	W	67.01/81.40/73.50	42.97/56.42/48.79	37.52/52.67/43.82	48.49/64.08/55.20
	A	64.21/80.74/71.54	43.52/60.89/50.76	38.78/55.07/45.51	48.74/65.94/56.05
	F	75.58/83.14/79.18	41.67/47.62/44.44	34.72/47.51/40.12	34.72/47.51/40.12
UTurku	W	68.22/76.47/72.11	42.97/43.60/43.28	38.72/47.64/42.72	49.56/57.65/53.30
	A	64.97/76.72/70.36	45.24/50.00/47.50	40.41/49.01/44.30	50.06/59.48/54.37
	F	78.18/75.82/76.98	37.50/31.76/34.39	34.99/44.46/39.16	48.31/53.38/50.72
MSR-NLP	W	68.99/74.30/71.54	42.36/40.47/41.39	36.64/44.08/40.02	48.64/54.71/51.50
	A	65.99/74.71/70.08	43.23/44.51/43.86	37.14/45.38/40.85	48.52/56.47/52.20
	F	78.18/73.24/ 75.63	40.28/32.77/36.14	35.52/41.34/38.21	48.94/50.77/49.84
STSS	W	—	—	—	—
	A	64.97/76.65/70.33	45.24/49.84/47.43	40.41/48.83/44.22	50.06/59.33/54.30
	F	78.18/75.63/76.88	37.50/31.58/34.29	34.99/44.69/39.25	48.31/53.43/50.74
Ours	W	68.60/80.34/74.01	47.66/56.52/51.71	38.97/43.88/41.28	50.35/57.79/53.81
	A	64.97/79.34/71.44	49.57/59.72/54.17	39.32/43.62/41.36	49.97/57.90/53.64
	F	79.74/82.97/81.32	43.06/49.21/45.93	38.20/44.46/41.10	51.29/57.52/54.23

Evaluation results (recall/precision/-score) in whole data set (W), abstracts only (A), and full papers only (F).