\n ## Diagram: Chain-of-Thought Prompting with Latent Variables ### Overview This diagram illustrates a comparison between standard Chain-of-Thought (CoT) prompting and a modified version incorporating latent variables. The diagram visually represents the sequence of tokens in both approaches, highlighting the insertion of latent tokens within the CoT sequence. ### Components/Axes The diagram consists of two horizontal sequences representing the token flow for each prompting method. Below the sequences are definitions for the components used in the diagram. The components are: * **Prompt:** The initial input to the model. * **CoT 1, CoT 2… CoT 32, CoT 33… CoT N:** Chain-of-Thought tokens, representing intermediate reasoning steps. 'N' denotes an arbitrary number of CoT tokens. * **Solution:** The final output of the model. * **[boLatent]:** A special delimiter indicating the beginning of latent tokens. * **[eoLatent]:** A special delimiter indicating the end of latent tokens. * **z1, z2:** Discrete latent tokens. ### Detailed Analysis or Content Details The diagram presents two prompting sequences: **Sequence 1 (Standard CoT):** * Starts with "Prompt" (light green). * Followed by a series of "CoT" tokens (light blue), ranging from "CoT 1" to "CoT N". The ellipsis indicates that there are multiple CoT tokens between "CoT 32" and "CoT 33". * Ends with "Solution" (light coral). **Sequence 2 (CoT with Latent Variables):** * Starts with "Prompt" (light green). * Followed by "[boLatent]" (lavender), "z1" (pink), "z2" (pink), and "[eoLatent]" (lavender). These represent the inserted latent tokens. * Continues with "CoT 33" (light blue) and "CoT N" (light blue) with an ellipsis indicating further CoT tokens. * Ends with "Solution" (light coral). The diagram also includes text: "Text" (red) is placed above the CoT 33 and CoT N tokens in the second sequence. The legend defines the components: * “[boLatent] [eoLatent]” – Special delimiters that encode the start / end of the latent tokens. * “z” – Discrete latent tokens. * “CoT N” – The n-th CoT textual tokens. ### Key Observations The key difference between the two sequences is the inclusion of latent variables ("z1", "z2") enclosed by delimiters ("[boLatent]", "[eoLatent]") in the second sequence. This suggests a modification to the standard CoT prompting method to incorporate a latent space representation within the reasoning process. The "Text" label suggests that the latent variables are influencing the subsequent CoT tokens. ### Interpretation The diagram illustrates a method for augmenting Chain-of-Thought prompting with latent variables. The standard CoT approach relies solely on textual tokens to generate reasoning steps. The modified approach introduces a latent space, represented by "z1" and "z2", which are presumably learned representations of information. These latent variables are inserted into the CoT sequence using special delimiters. This suggests that the latent variables are intended to guide or influence the subsequent reasoning steps ("CoT 33" onwards). The inclusion of "Text" above the CoT tokens implies that the latent variables are impacting the generated text. This approach could potentially improve the quality of reasoning by allowing the model to leverage a more compact and informative representation of knowledge. The use of delimiters ensures that the latent variables are properly integrated into the token sequence. The diagram highlights a research direction aimed at enhancing CoT prompting through the incorporation of latent space representations.