Table 2 The average results (%) from three consecutive comparative experiments on the 1/2, 1/4, 1/8, 1/12, and 1/16 datasets include outcomes for 14 metrics across three verb settings, evaluated on both the full validation and test sets.

From: Grounded situation recognition under data scarcity

Dataset

Set

Method

Top-1 predicted verb

Top-5 predicted verb

Ground-truth verb

Verb

Value

Value-all

Grnd value

Grnd value-all

Verb

Value

Value-all

Grnd value

Grnd value-all

Value

Value-all

Grnd value

Grnd value-all

1/2

dev

GSRTR10

31.24

23.86

13.74

18.77

6.99

58.85

43.7

23.6

33.94

11.48

70.22

33.62

53.55

16.04

CoFormer12

37.08

29.14

17.42

23.63

9.61

65.27

49.91

27.92

39.98

14.92

72.8

36.96

57.65

19.48

OpenSU15

41.68

33.31

20.31

27.41

11.59

70.19

54.96

32.12

44.81

17.9

75.12

40.6

60.52

22.22

GSRDS(Ours)

47.82

37.07

21.31

29.75

11.62

76.02

57.64

31.37

46

16.77

73.22

37.15

57.93

19.54

test

GSRTR10

31.17

23.84

13.48

18.52

6.85

59.44

44.15

23.48

33.93

11.5

70.05

32.81

52.75

15.53

CoFormer12

37.71

29.52

17.43

23.55

9.42

66.15

50.48

28.07

39.97

14.78

72.74

36.92

56.87

19.04

OpenSU15

41.88

33.44

20.44

27.09

11.4

70.31

54.96

32.18

44.28

17.73

75.09

40.6

59.72

21.85

GSRDS(Ours)

47.91

36.97

20.94

29.34

11.1

76.33

57.64

31.01

45.42

16.04

73.02

36.82

57.02

18.81

1/4

dev

GSRTR10

21.93

16.06

8.67

11.13

3.24

47.09

33.25

16.55

22.78

6.18

65.62

27.65

43.95

10.2

CoFormer12

30.66

23.45

13.38

18.34

6.81

57.48

42.38

22.35

32.75

10.84

69.35

32.25

52.79

15.32

OpenSU15

35.58

27.66

16.06

22.04

8.57

62.66

47.37

25.88

37.43

13.39

71.43

34.88

55.73

17.77

GSRDS(Ours)

42.92

32.64

18.1

25.3

9.06

70.35

52.34

27.56

40.32

13.41

71.45

34.54

54.47

16.3

test

GSRTR10

21.91

16.02

8.54

10.98

3.29

47.6

33.55

16.63

22.74

6.23

65.43

27.34

43.34

9.87

CoFormer12

30.49

23.07

12.72

17.79

6.26

57.75

42.63

22.24

32.59

10.67

69.19

31.74

52.07

14.79

OpenSU15

36.07

27.75

15.92

21.98

8.41

63.09

47.4

25.61

37.06

13.1

71.32

34.75

55.02

17.39

GSRDS(Ours)

43.08

32.7

18.06

25.23

9.07

70.77

52.5

27.39

39.95

13.13

71.22

34.28

53.7

16.12

1/8

dev

GSRTR10

14.17

9.94

5.1

7.27

2.1

34.81

23.3

10.77

16.97

4.5

61.22

22.72

43.48

9.23

CoFormer12

23.69

17.5

9.52

13.1

4.33

48.02

34.22

17.06

25.35

7.64

65.46

27.23

47.73

11.81

OpenSU15

29.13

22.02

12.14

16.56

5.51

54.28

39.61

20.27

29.36

8.95

67.72

29.92

49.79

13.12

GSRDS(Ours)

37.04

27.49

14.73

21

7.02

63.9

46.06

23.03

34.92

10.71

68.03

30.18

50.92

13.81

test

GSRTR10

14.16

9.97

4.96

7.25

2.06

35.39

23.64

10.71

17

4.45

61

22.37

42.83

8.92

CoFormer12

23.77

17.43

9.11

12.92

4.04

48.08

34.03

16.49

24.92

7.08

65.22

26.77

47.23

11.39

OpenSU15

29.28

21.99

11.72

16.31

5.18

54.66

39.54

19.8

29.07

8.52

67.48

29.58

49.07

12.59

GSRDS(Ours)

37.45

27.66

14.62

20.85

6.93

64.56

46.35

22.82

34.68

10.48

67.89

30.01

50.29

13.55

1/12

dev

GSRTR10

9.65

6.55

3.25

4.43

1.28

26.12

16.84

7.55

11.37

3

57.64

19.27

37.75

7.29

CoFormer12

19.68

14.06

7.15

9.48

2.52

42.41

29.15

13.63

19.59

4.81

62.7

24.1

41.61

8.73

OpenSU15

25.46

18.81

9.96

12.63

3.45

48.9

34.73

17.01

23.14

5.81

65.3

27.08

43.25

9.56

GSRDS(Ours)

32.82

23.82

12.18

17.8

5.51

58.94

41.33

19.67

30.82

8.86

65.68

27.19

48.46

12.01

test

GSRTR10

9.57

6.47

3.17

4.29

1.11

26.21

16.92

7.5

11.29

2.71

57.6

19.15

37.26

6.85

CoFormer12

19.8

14.23

7.33

9.59

2.62

42.06

28.88

13.42

19.17

4.66

62.55

23.98

41.1

8.6

OpenSU15

25.23

18.44

9.54

12.35

3.38

48.57

34.25

16.41

22.66

5.69

64.94

26.72

42.78

9.65

GSRDS(Ours)

32.79

23.95

12.35

17.78

5.75

58.95

41.63

19.91

30.66

8.97

65.87

27.54

48.03

12.2

1/16

dev

GSRTR10

5.68

3.69

1.79

2.51

0.65

17.7

10.92

4.71

7.36

1.68

55.05

16.91

35.6

5.89

CoFormer12

16.59

11.78

6.04

7.96

2.15

37.25

25.14

11.32

16.74

3.99

60.87

22

40.05

8.06

OpenSU15

22.46

16.33

8.45

10.91

2.85

44.75

31.27

14.79

20.78

4.96

63.17

24.45

41.78

8.8

GSRDS(Ours)

30.02

21.31

10.46

15.72

4.76

54.75

37.62

17.21

27.65

7.81

63.76

24.96

46.48

11.08

test

GSRTR10

5.74

3.79

1.94

2.53

0.69

17.85

11.16

4.96

7.43

1.8

55.03

16.79

35.17

5.94

CoFormer12

16.85

12.01

6.13

8.02

2.16

37.64

25.44

11.45

16.75

3.93

60.82

21.87

39.49

7.82

OpenSU15

22.57

16.51

8.65

10.87

2.79

45

31.31

14.69

20.52

4.88

63.33

24.31

41.4

8.57

GSRDS(Ours)

30.21

21.55

10.74

15.7

4.85

55.14

37.72

16.94

27.29

7.5

63.61

24.5

45.61

10.67

Back to article page