"links to individual test reports"
Starting at file #211 in the list
<https://12000.org/my_notes/CAS_integration_tests/reports/summer_2022/index.htm/>
At the very bottom of the page.
=============
1. Mathematica 13.2.1 98.73 %
2. Fricas 1.3.8/sage 9.8 96.52 %
3. Maple 2022.2 94.3 %
4. Rubi 4.16.1 93.35 %
5. Maxima 5.46/sage 9.8 92.41 %
6. Giac 1.9.0-37/sage 9.8 91.77 %
7. Mupad Matlab 2021a 89.56 %
8. Sympy 1.11.1 82.28 %
FYI
MIT Integration Bee problems are now included in the
CAS integration tests.
These problems came from https://math.mit.edu/~yyao1/integrationbee.html
Updated the summer 2022 edition of the CAS integration
tests pages to include these problems showing the result
for all CAS systems currently supported. They can be
found under the link called
"links to individual test reports"
Starting at file #211 in the list
<https://12000.org/my_notes/CAS_integration_tests/reports/summer_2022/index.htm/>
At the very bottom of the page.
(one file per year starting from 2010, and per each
competition held) so they match the order shown in the MIT
page above.
A number (may be half) of the MIT integration problems
are definite, so those were solved as indefinite integration
only as that is the only mode supported.
316 new integrals were added. The total number of
integrals now is 85,795.
This is the result of percentage solved per each CAS just
for the MIT problems section (i.e. 316 problems).
=============
1. Mathematica 13.2.1 98.73 %
2. Fricas 1.3.8/sage 9.8 96.52 %
3. Maple 2022.2 94.3 %
4. Rubi 4.16.1 93.35 %
5. Maxima 5.46/sage 9.8 92.41 %
6. Giac 1.9.0-37/sage 9.8 91.77 %
7. Mupad Matlab 2021a 89.56 %
8. Sympy 1.11.1 82.28 %
Any problems, issues, please let me know so I can fix it.
--Nasser
On 3/3/2023 12:57 PM, Nasser M. Abbasi wrote:
"links to individual test reports"
Starting at file #211 in the list
<https://12000.org/my_notes/CAS_integration_tests/reports/summer_2022/index.htm/>
At the very bottom of the page.
=============
1. Mathematica 13.2.1 98.73 %
2. Fricas 1.3.8/sage 9.8 96.52 %
3. Maple 2022.2 94.3 %
4. Rubi 4.16.1 93.35 %
5. Maxima 5.46/sage 9.8 92.41 %
6. Giac 1.9.0-37/sage 9.8 91.77 %
7. Mupad Matlab 2021a 89.56 %
8. Sympy 1.11.1 82.28 %
FYI
MIT Integration Bee problems are now included in the
CAS integration tests.
These problems came from https://math.mit.edu/~yyao1/integrationbee.html
Updated the summer 2022 edition of the CAS integration
tests pages to include these problems showing the result
for all CAS systems currently supported. They can be
found under the link called
"links to individual test reports"
Starting at file #211 in the list
<https://12000.org/my_notes/CAS_integration_tests/reports/summer_2022/index.htm/>
At the very bottom of the page.
(one file per year starting from 2010, and per each
competition held) so they match the order shown in the MIT
page above.
A number (may be half) of the MIT integration problems
are definite, so those were solved as indefinite integration
only as that is the only mode supported.
316 new integrals were added. The total number of
integrals now is 85,795.
This is the result of percentage solved per each CAS just
for the MIT problems section (i.e. 316 problems).
=============
1. Mathematica 13.2.1 98.73 %
2. Fricas 1.3.8/sage 9.8 96.52 %
3. Maple 2022.2 94.3 %
4. Rubi 4.16.1 93.35 %
5. Maxima 5.46/sage 9.8 92.41 %
6. Giac 1.9.0-37/sage 9.8 91.77 %
7. Mupad Matlab 2021a 89.56 %
8. Sympy 1.11.1 82.28 %
Any problems, issues, please let me know so I can fix it.
--Nasser
FYI,
Made new build to the MIT integration bee test file.
<https://12000.org/my_notes/CAS_integration_tests/reports/summer_2022/test_cases/11_MIT/report.htm>
Thanks to Albert Rich adding few more integrals, I rebuild
this file using now the latest Mathematica 13.2.1 and Maple 2023
versions. There are now 321 problems in this file up from 316.
Current result for % solved is
Mathematica 99.38
Fricas 96.26
Maple 95.33
Rubi 94.39
Maxima 92.52
Giac 91.59
Mupad 90.03
Sympy 82.24
In terms of % of getting an A grade for quality of antiderivatives
that were solved, the result is
Rubi 89.10
Mathematica 87.54
Maple 80.06
Fricas 77.88
Maxima 75.88
Giac 73.52
Sympy 62.31
Mupad Not graded.
Any problems please let me know.
--Nasser
On 3/3/2023 12:57 PM, Nasser M. Abbasi wrote:
FYI
MIT Integration Bee problems are now included in the
CAS integration tests.
These problems came from https://math.mit.edu/~yyao1/integrationbee.html
Updated the summer 2022 edition of the CAS integration
tests pages to include these problems showing the result
for all CAS systems currently supported. They can be
found under the link called
"links to individual test reports"
Starting at file #211 in the list
<https://12000.org/my_notes/CAS_integration_tests/reports/summer_2022/index.htm/>
At the very bottom of the page.
(one file per year starting from 2010, and per each
competition held) so they match the order shown in the MIT
page above.
A number (may be half) of the MIT integration problems
are definite, so those were solved as indefinite integration
only as that is the only mode supported.
316 new integrals were added. The total number of
integrals now is 85,795.
This is the result of percentage solved per each CAS just
for the MIT problems section (i.e. 316 problems).
=============
1. Mathematica 13.2.1 98.73 %
2. Fricas 1.3.8/sage 9.8 96.52 %
3. Maple 2022.2 94.3 %
4. Rubi 4.16.1 93.35 %
5. Maxima 5.46/sage 9.8 92.41 %
6. Giac 1.9.0-37/sage 9.8 91.77 %
7. Mupad Matlab 2021a 89.56 %
8. Sympy 1.11.1 82.28 %
Any problems, issues, please let me know so I can fix it.
Also note that FriCAS did not really fail on #287:
<https://12000.org/my_notes/CAS_integration_tests/reports/summer_2022/test_cases/11_MIT/reportsubsection9.htm#x13-220002.1.5>
Here, a polynomial integrand equals zero:
integrate((1-x)^3+(-x^2+x)^3+(x^2-1)^3-3*(1-x)*(-x^2+x)*(x^2-1), x)
Martin.
fricasFriCAS Computer Algebra System
<https://12000.org/my_notes/CAS_integration_tests/reports/summer_2022/test_cases/11_MIT/reportsubsection5.htm#x9-180002.1.1>
In these cases Rubi fails on:
Int[(Sec[x] + Sin[x])^(-1), x]
Int[Cos[x]*Cosh[x] + Sin[x]*Sinh[x], x]
Int[(Cos[x] - Sin[x])/(2 + Sin[2*x]), x]
Int[ArcCos[x]*ArcSin[x], x]
Int[(E^(x^(-1) + x)*(-1 - x^2 + x^4 + x^6))/x^4, x]
Int[x^(-Log[x]), x]
The last integral could just be a terminal rule, I suppose; I am not so
sure what to do about the next-to-last one. Some of the integrands
causing Rubi may be considered ill-posed, like #250, #317:
Int[Sqrt[1 - ArcCos[Sin[x]]^2], x]
Int[Sin[4*ArcTan[x]], x]
They should perhaps be preprocessed by a strong simplifier at the
user's discretion.
On 4/29/2023 11:09 AM, clicliclic@freenet.de wrote:
Also note that FriCAS did not really fail on #287:
<https://12000.org/my_notes/CAS_integration_tests/reports/summer_2022/test_cases/11_MIT/reportsubsection9.htm#x13-220002.1.5>
Here, a polynomial integrand equals zero:
integrate((1-x)^3+(-x^2+x)^3+(x^2-1)^3-3*(1-x)*(-x^2+x)*(x^2-1), x)
Thanks. Yes, I knew about this but forget to fix it.
I finally added code to handle this special case for Fricas.
Fricas has bug where it can return zero on non-zero integrands
<https://groups.google.com/g/fricas-devel/c/OcHBQgoBONM>
----------------------
fricasFriCAS Computer Algebra System
Version: FriCAS 1.3.8
(1) -> integrate(x/sqrt(1-x^3),x)
(1) 0
1) -> integrate(x/(-x^3+1)^(1/2),x)
(1) 0
(2) -> integrate(x/(-x^3+1)^(1/2),x)
(2) 0
(3) -> integrate(1/2*(log(a*x-1)-2*log(-(a*x-1)^(1/2)))/pi/(a*x-1)^(1/2),x)
(3) 0
------------------------------
Hopefully the above will be fixed in Fricas 1.3.9.
So the program was checking if the integrand is
not zero but the anti-derivative was zero, and making it failed.
The test program should first fully simplify the integrand
and only then do the checking. It was not doing this.
So I just fixed this and updated the page.
--------from Fricas sagemath script -----
if anti.full_simplify()==0:
if integrand.full_simplify()==0: #add full_simplify()
return passed
else:
return failed
----------------------------------------
Now Fricas gets a pass on this one with A grade.
[...]
Fricas has bug where it can return zero on non-zero integrands
<https://groups.google.com/g/fricas-devel/c/OcHBQgoBONM>
----------------------
fricasFriCAS Computer Algebra System
Version: FriCAS 1.3.8
(1) -> integrate(x/sqrt(1-x^3),x)
(1) 0
1) -> integrate(x/(-x^3+1)^(1/2),x)
(1) 0
(2) -> integrate(x/(-x^3+1)^(1/2),x)
(2) 0
(3) -> integrate(1/2*(log(a*x-1)-2*log(-(a*x-1)^(1/2)))/pi/(a*x-1)^(1/2),x)
(3) 0
------------------------------
Hopefully the above will be fixed in Fricas 1.3.9.
fricasFriCAS Computer Algebra System
Sysop: | Keyop |
---|---|
Location: | Huddersfield, West Yorkshire, UK |
Users: | 486 |
Nodes: | 16 (2 / 14) |
Uptime: | 138:41:13 |
Calls: | 9,657 |
Calls today: | 5 |
Files: | 13,708 |
Messages: | 6,167,228 |