• FYI, new SQLlite interface to the Independent CAS integration tests ava

    From Nasser M. Abbasi@21:1/5 to All on Wed Aug 24 04:40:36 2022
    FYI

    posted at https://groups.google.com/g/fricas-devel and https://groups.google.com/g/sci.math.symbolic
    ---------------------------

    <https://12000.org/my_notes/CAS_integration_tests/reports/summer_2022/DATA_BASE/index.htm>


    To make it easier to query the Independent CAS integration tests results,
    there is now an SQLite database which contains all relevant results
    generated during testing. This is meant to complement the reports
    and the webpages and not replace them.

    The database and the reports were all generated from the same CSV tables
    after running the integration tests. But using the SQL database it
    is much easier to obtain the information needed by issuing SQL commands.

    To use the database requires the free sqlite3 software. There is
    also a free GUI interface.

    There is an initial release of the database now with information how to
    install it and the software needed use it at the above link.

    The database is not fully populated yet, but can be used immediately.
    It will take about another 1-2 weeks. The above page will indicate
    when the database is completed.

    Examples are given on the above page how to use it.

    Any problems/bugs please let me know.

    --Nasser

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Nasser M. Abbasi@21:1/5 to Nasser M. Abbasi on Thu Sep 22 06:39:15 2022
    On 8/24/2022 4:40 AM, Nasser M. Abbasi wrote:
    FYI

    posted at https://groups.google.com/g/fricas-devel and https://groups.google.com/g/sci.math.symbolic
    ---------------------------

    <https://12000.org/my_notes/CAS_integration_tests/reports/summer_2022/DATA_BASE/index.htm>


    To make it easier to query the Independent CAS integration tests results, there is now an SQLite database which contains all relevant results
    generated during testing. This is meant to complement the reports
    and the webpages and not replace them.

    The database and the reports were all generated from the same CSV tables after running the integration tests. But using the SQL database it
    is much easier to obtain the information needed by issuing SQL commands.

    To use the database requires the free sqlite3 software. There is
    also a free GUI interface.

    There is an initial release of the database now with information how to install it and the software needed use it at the above link.

    The database is not fully populated yet, but can be used immediately.
    It will take about another 1-2 weeks. The above page will indicate
    when the database is completed.

    Examples are given on the above page how to use it.

    Any problems/bugs please let me know.

    --Nasser


    Fyi,

    CAS integrations tests SQL database is now fully build.

    <http://localhost/my_notes/CAS_integration_tests/reports/summer_2022/DATA_BASE/index.htm>

    After extracting the zip file, the size of the db is 1.3 GB.

    Total number of intergrals in the database is

    sqlite> select COUNT(*) from main;
    85479

    Any problems please let me know.

    --Nasser

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Nasser M. Abbasi@21:1/5 to Nasser M. Abbasi on Thu Sep 22 07:28:25 2022
    On 9/22/2022 6:39 AM, Nasser M. Abbasi wrote:


    CAS integrations tests SQL database is now fully build.

    <http://localhost/my_notes/CAS_integration_tests/reports/summer_2022/DATA_BASE/index.htm>

    After extracting the zip file, the size of the db is 1.3 GB.

    Total number of intergrals in the database is

    sqlite> select COUNT(*) from main;
    85479

    Any problems please let me know.


    Just wanted to point out something that might not be clear in
    case someone things there is something wrong in the data.

    When checking how many integrals a CAS failed to solve, for example,
    using Fricas

    sqlite> select count(*) from main where fricas_pass=1;

    64582

    But this gives %pass of 75.55% but that is not the actual pass %. The
    reason is that in final report, integrals which are not integrable
    are counted as passed. But in the database itself, only the
    initial score is recorded. The database only contains the raw
    data.

    The database has

    sqlite> select count(*) from main where has_known_anti=0;

    3561

    i.e. there are 3,561 integrals that are non-integrable. So any
    cas that fail these _within the time limit_, is counted as
    passed, not failed.

    So to obtain the correct number of passed integrals for cas
    the command is

    sqlite> select count(*) from main where fricas_pass=1
    or (fricas_pass=0 and has_known_anti=0);

    67589

    And now this gives percentage of 79.07% which is the correct % for fricas.
    THe same thing should be done for other CASes.

    Note that in this update, Fricas results of 0 for anti-derivative
    are detected now and counted as failed. Before there were counted
    as passed. This only reduced Fricas score by just about 0.14% as
    there was only 125 such integrals.

    sqlite> select count(*) from main where fricas_anti=0;
    125

    --Nasser

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)