Table 2 Definitions of actions used in DDQN.

From: Double-deep Q-learning to increase the efficiency of metasurface holograms

Action No.

Action Definition

0

Decrease the spacing between disks (L) by 10 nm. (min 20 nm)

1

Increase the spacing between disks (L) by 10 nm. (max 120 nm)

2

Decrease the grating thickness (G_H) by 10 nm. (min 10 nm)

3

Increase the grating thickness (G_H) by 10 nm. (max 150 nm)

4

Decrease the disk thickness (D_H) by 10 nm. (min 10 nm)

5

Increase the disk thickness (D_H) by 10 nm. (max 250 nm)

6

Decrease the film thickness (F_H) by 10 nm. (min 10 nm)

7

Increase the film thickness (F_H) by 10 nm. (max 150 nm)

8

Decrease the grating coverage (G_C) by 10%. (min 0%)

9

Increase the grating coverage (G_C) by 10%. (max 100%)

10

Decrease the material ID of disks (D_M) by 1. (min 1)

11

Increase the material ID of disks (D_M) by 1. (max 23)

12

Decrease the material ID of the film (F_M) by 1. (min 1)

13

Increase the material ID of the film (F_M) by 1. (max 23)

14

Decrease the material ID of the grating (G_M) by 1. (min 1)

15

Increase the material ID of the grating (G_M) by 1. (max 23)