Fig. 1: Overview of our motivations and contributions.
From: Self-reflection enhances large language models towards substantial academic response
a The figure depicts the shallow reasoning problem of the LLM in response writing. When LLM is asked to respond to the reviewer’s comment, it might output a polished response that seems logical but does not actually answer the core concern. b illustrates the flow of existing reflection methods, where they introspect only through self-knowledge and focus on the output AM rather than the entire reasoning process. c illustrates the proposed idea of dual-loop reflection that includes extrospection and introspection. The LLM is first instructed to detach from itself and critique its own reasoning process with human reference responses, i.e., extrospection. When reasoning, the LLM rewrites the initial response based on the reflection of the extrospection, i.e., introspection. d Illustrates the flow of the proposed method. First, we utilize publicly available peer review documents to instruct the LLM to generate responses and critique its own reasoning process with human reference responses, i.e., extrospection. When online reasoning, these reflections derived from extrospection will be retrieved, guiding the LLM to introspect on past shortcomings when solving similar comments at hand.
