• The anchoring problem in a real world philosopher (Re: LLM and Prolog,

    From Mild Shock@21:1/5 to Mild Shock on Thu Aug 8 17:11:29 2024
    Hi,

    Lets say one milestone in cognitive science,
    is the concept of "bounded rationality".
    It seems LLMs have some traits that are also

    found in humans. For example the anchoring effect
    is a psychological phenomenon in which an
    individual’s judgements or decisions

    are influenced by a reference point or “anchor”
    which can be completely irrelevant. Like for example
    when discussing Curry Howard isomorphism with

    a real world philosopher , one that might
    not know Curry Howard isomorphism but

    https://en.wikipedia.org/wiki/Anchoring_effect

    nevertheless be tempted to hallucinate some nonsense.
    One highly cited paper in this respect is Tversky &
    Kahneman 1974. R.I.P. Daniel Kahneman,

    March 27, 2024. The paper is still cited today:

    Artificial Intelligence and Cognitive Biases: A Viewpoint https://www.cairn.info/revue-journal-of-innovation-economics-2024-2-page-223.htm

    Maybe using deeper and/or more careful reasoning,
    possibly backed up by Prolog engine, could have
    a positive effect? Its very difficult also for a

    Prolog engine, since there is a trade-off
    between producing no answer at all if the software
    agent is too careful, and of producing a wealth

    of nonsense otherwise.

    Bye

    Mild Shock schrieb:
    There are more and more papers of this sort:

    Reliable Reasoning Beyond Natural Language
    To address this, we propose a neurosymbolic
    approach that prompts LLMs to extract and encode
    all relevant information from a problem statement as
    logical code statements, and then use a logic programming
    language (Prolog) to conduct the iterative computations of
    explicit deductive reasoning.
    [2407.11373] Reliable Reasoning Beyond Natural Language

    The future of Prolog is bright?

    Mild Shock schrieb:
    Could be a wake-up call this many participants
    already in the commitee, that the whole logic
    world was asleep for many years:

    Non-Classical Logics. Theory and Applications XI,
    5-8 September 2024, Lodz (Poland)
    https://easychair.org/cfp/NCL24

    Why is Minimal Logic at the core of many things?
    Because it is the logic of Curry-Howard isomorphism
    for simple types:

    ----------------
    Γ ∪ { A } ⊢ A

    Γ ∪ { A } ⊢ B
    ----------------
    Γ ⊢ A → B

    Γ ⊢ A → B           Δ ⊢ A
    ----------------------------
    Γ ∪ Δ ⊢ B

    And funny things can happen, especially when people
    hallucinate duality or think symmetry is given, for
    example in newer inventions such as λμ-calculus,

    but then omg ~~p => p is nevertheless not provable,
    because they forgot an inference rule. LoL

    Recommended reading so far:

    Propositional Logics Related to Heyting’s and Johansson’s
    February 2008 - Krister Segerberg
    https://www.researchgate.net/publication/228036664

    The Logic of Church and Curry
    Jonathan P. Seldin - 2009
    https://www.sciencedirect.com/handbook/handbook-of-the-history-of-logic/vol/5/suppl/C


    Meanwhile I am going back to my tinkering with my
    Prolog system, which even provides a more primitive
    logic than minimal logic, pure Prolog is minimal

    logic without embedded implication.


    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Mild Shock@21:1/5 to Mild Shock on Thu Aug 8 17:19:55 2024
    But I wouldn’t give up so quickly, even
    classical expert system theory of the 80’s
    had it that an expert system needs somewhere

    a knowledge acquisition component. But the
    idea there was that the system would simulate
    the experts dialog with the advice taker

    Von Datenbanken zu Expertsystemen https://www.orellfuessli.ch/shop/home/artikeldetails/A1051258432

    and gather further information to complete
    the advice. Still this could be inspiring,
    don’t stop at not knowing Curry-Howard isomorphism,

    go on learn it, never stop! Just like here:

    Never Gonna Give You Up
    https://www.youtube.com/watch?v=dQw4w9WgXcQ

    Mild Shock schrieb:
    Hi,

    Lets say one milestone in cognitive science,
    is the concept of "bounded rationality".
    It seems LLMs have some traits that are also

    found in humans. For example the anchoring effect
    is a psychological phenomenon in which an
    individual’s judgements or decisions

    are influenced by a reference point or “anchor”
    which can be completely irrelevant. Like for example
    when discussing Curry Howard isomorphism with

    a real world philosopher , one that might
    not know Curry Howard isomorphism but

    https://en.wikipedia.org/wiki/Anchoring_effect

    nevertheless be tempted to hallucinate some nonsense.
    One highly cited paper in this respect is Tversky &
    Kahneman 1974. R.I.P. Daniel Kahneman,

    March 27, 2024. The paper is still cited today:

    Artificial Intelligence and Cognitive Biases: A Viewpoint https://www.cairn.info/revue-journal-of-innovation-economics-2024-2-page-223.htm


    Maybe using deeper and/or more careful reasoning,
    possibly backed up by Prolog engine, could have
    a positive effect? Its very difficult also for a

    Prolog engine, since there is a trade-off
    between producing no answer at all if the software
    agent is too careful, and of producing a wealth

    of nonsense otherwise.

    Bye

    Mild Shock schrieb:
    There are more and more papers of this sort:

    Reliable Reasoning Beyond Natural Language
    To address this, we propose a neurosymbolic
    approach that prompts LLMs to extract and encode
    all relevant information from a problem statement as
    logical code statements, and then use a logic programming
    language (Prolog) to conduct the iterative computations of
    explicit deductive reasoning.
    [2407.11373] Reliable Reasoning Beyond Natural Language

    The future of Prolog is bright?

    Mild Shock schrieb:
    Could be a wake-up call this many participants
    already in the commitee, that the whole logic
    world was asleep for many years:

    Non-Classical Logics. Theory and Applications XI,
    5-8 September 2024, Lodz (Poland)
    https://easychair.org/cfp/NCL24

    Why is Minimal Logic at the core of many things?
    Because it is the logic of Curry-Howard isomorphism
    for simple types:

    ----------------
    Γ ∪ { A } ⊢ A

    Γ ∪ { A } ⊢ B
    ----------------
    Γ ⊢ A → B

    Γ ⊢ A → B           Δ ⊢ A
    ----------------------------
    Γ ∪ Δ ⊢ B

    And funny things can happen, especially when people
    hallucinate duality or think symmetry is given, for
    example in newer inventions such as λμ-calculus,

    but then omg ~~p => p is nevertheless not provable,
    because they forgot an inference rule. LoL

    Recommended reading so far:

    Propositional Logics Related to Heyting’s and Johansson’s
    February 2008 - Krister Segerberg
    https://www.researchgate.net/publication/228036664

    The Logic of Church and Curry
    Jonathan P. Seldin - 2009
    https://www.sciencedirect.com/handbook/handbook-of-the-history-of-logic/vol/5/suppl/C


    Meanwhile I am going back to my tinkering with my
    Prolog system, which even provides a more primitive
    logic than minimal logic, pure Prolog is minimal

    logic without embedded implication.



    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)