AI Test Bed: OpenStax Textbooks (Creative Commons Attribution 4.0 International License)

Source: https://openstax.org/

OpenStax’s mission is to improve educational access and learning for everyone. OpenStax is part of Rice University, which is a 501(c)(3) nonprofit.

textbooks on this site are licensed under a Creative Commons Attribution 4.0 International License.

Advanced Placement® and AP® are trademarks registered and/or owned by the College Board, which is not affiliated with and does not endorse this site. Give today and help us reach more students.

Test Lab: https://labs.perplexity.ai/

  1. Algebra and Trigonometry 2e:
    https://ideal-group.org/ai-library/Algebra-and-Trigonometry-2e.pdf
  2. American Government 3e:
    https://ideal-group.org/ai-library/AmericanGovernment3e.pdf
  3. AP Biology:
    https://ideal-group.org/ai-library/APBiology.pdf
  4. Biology 2e:
    https://ideal-group.org/ai-library/Biology2e.pdf
  5. Business Ethics:
    https://ideal-group.org/ai-library/BusinessEthics.pdf
  6. Business Law I Essentials:
    https://ideal-group.org/ai-library/Business_Law_I_Essentials.pdf
  7. Business Statistics:
    https://ideal-group.org/ai-library/IntroductoryBusinessStatistics.pdf
  8. Calculus Volume 1:
    https://ideal-group.org/ai-library/Calculus_Volume_1.pdf
  9. Calculus Volume 2:
    https://ideal-group.org/ai-library/CalculusVolume2.pdf
  10. Calculus Volume 3:
    https://ideal-group.org/ai-library/CalculusVolume3.pdf
  11. College Algebra 2e:
    https://ideal-group.org/ai-library/College-Algebra-2e.pdf
  12. College Algebra Corequisite Support 2e:
    https://ideal-group.org/ai-library/College-Algebra-Corequisite-Support-2e.pdf
  13. Concepts of Biology:
    https://ideal-group.org/ai-library/ConceptsofBiology.pdf
  14. Contemporary Mathematics:
    https://ideal-group.org/ai-library/ContemporaryMathematics.pdf
  15. Economics 3e:
    https://ideal-group.org/ai-library/Economics3e.pdf
  16. Elementary Algebra 2e:
    https://ideal-group.org/ai-library/ElementaryAlgebra2e.pdf
  17. Entrepreneurship:
    https://ideal-group.org/ai-library/Entrepreneurship.pdf
  18. Intermediate Algebra 2e:
    https://ideal-group.org/ai-library/IntermediateAlgebra2e.pdf
  19. Introduction to Anthropology:
    https://ideal-group.org/ai-library/IntroductiontoAnthropology.pdf
  20. Introduction To Business:
    https://ideal-group.org/ai-library/IntroductionToBusiness.pdf
  21. Introduction to Intellectual Property:
    https://ideal-group.org/ai-library/Introduction_to_Intellectual_Property.pdf
  22. Introduction to Philosophy:
    https://ideal-group.org/ai-library/Introduction_to_Philosophy.pdf
  23. Introduction to Political Science:
    https://ideal-group.org/ai-library/Introduction_to_Political_Science.pdf
  24. Introduction to Sociology 3e:
    https://ideal-group.org/ai-library/IntroductiontoSociology3e.pdf
  25. Introductory Business Statistics 2e:
    https://ideal-group.org/ai-library/Introductory_Business_Statistics_2e.pdf
  26. Introductory Statistics 2e:
    https://ideal-group.org/ai-library/Introductory_Statistics_2e.pdf
  27. Introductory Statistics:
    https://ideal-group.org/ai-library/IntroductoryStatistics.pdf
  28. Macroeconomics 3e:
    https://ideal-group.org/ai-library/Macroeconomics3e.pdf
  29. Microeconomics 3e:
    https://ideal-group.org/ai-library/Microeconomics3e.pdf
  30. Nutrition for Nurses:
    https://ideal-group.org/ai-library/Nutrition_for_Nurses.pdf
  31. Prealgebra 2e:
    https://ideal-group.org/ai-library/Prealgebra2e.pdf
  32. Precalculus 2e:
    https://ideal-group.org/ai-library/Precalculus_2e.pdf
  33. Principles of Finance:
    https://ideal-group.org/ai-library/PrinciplesofFinance.pdf
  34. Principles of Marketing:
    https://ideal-group.org/ai-library/Principles_Marketing.pdf
  35. Psychology 2e:
    https://ideal-group.org/ai-library/Psychology2e.pdf
  36. Statistics:
    https://ideal-group.org/ai-library/Statistics.pdf
  37. U.S. History:
    https://ideal-group.org/ai-library/USHistory.pdf
  38. World History Volume 1:
    https://ideal-group.org/ai-library/World_History_Volume_1.pdf
  39. World History Volume 2:
    https://ideal-group.org/ai-library/World_History_Volume_2.pdf

Llama 3 Examples:

Prompt #1:
Response #1:
I’d be happy to summarize Chapter 1 of the AP Biology textbook provided by the IDEAL Group.
**Chapter 1: The Nature of Science and the Scientific Method**
This chapter introduces the fundamental principles of science and the scientific method. Here’s a summary of the key points:
**What is Science?**
* Science is a systematic process of observation, experimentation, and evidence-based reasoning to understand the natural world.
* It involves formulating hypotheses, testing them through experimentation, and drawing conclusions based on the results.
* Science is a human endeavor, and its principles and methods are designed to be objective and unbiased.
**The Scientific Method**
* The scientific method is a step-by-step process for developing and testing scientific knowledge.
* The steps are:
1. **Make an observation**: Scientists observe a phenomenon or pattern in the natural world.
2. **Ask a question**: Scientists formulate a question based on their observation.
3. **Research the topic**: Scientists gather information and data related to the question.
4. **Formulate a hypothesis**: Scientists propose a possible explanation for the phenomenon or pattern.
5. **Design an experiment**: Scientists design an experiment to test the hypothesis.
6. **Conduct the experiment**: Scientists carry out the experiment and collect data.
7. **Analyze the data**: Scientists analyze the data to determine if it supports or rejects the hypothesis.
8. **Draw conclusions**: Scientists draw conclusions based on the results of the experiment.
9. **Communicate the results**: Scientists share their findings with others in the scientific community.
**Key Concepts**
* **Empiricism**: The idea that knowledge comes from sense experience and observation.
* **Objectivity**: The goal of science is to be objective and unbiased in its findings and conclusions.
* **Testability**: Scientific theories and hypotheses must be testable and falsifiable.
* **Peer review**: The process of having other scientists review and critique research findings before they are published.
**Conclusion**
This chapter sets the stage for the rest of the AP Biology course by introducing the fundamental principles of science and the scientific method. It emphasizes the importance of objectivity, testability, and peer review in the scientific process.
llama-3-8b-instruct
0.14  SEC TO FIRST TOKEN
124 TOKENS/SEC
447  TOKENS
3.59  SEC
Prompt #2:
Response #2:
Here is an outline of Chapter 1:
The Nature of Science and the Scientific Method from the AP Biology textbook provided by the IDEAL Group:
**I. Introduction**
* Definition of science and its importance
* Brief overview of the scientific method
**II. The Nature of Science**
* Definition of science: systematic process of observation, experimentation, and evidence-based reasoning
* Characteristics of science:
+ Empiricism: knowledge comes from sense experience and observation
+ Objectivity: goal of science is to be objective and unbiased
+ Testability: scientific theories and hypotheses must be testable and falsifiable
+ Predictability: scientific theories and hypotheses must be able to make predictions that can be tested
**III. The Scientific Method**
* Definition of the scientific method: step-by-step process for developing and testing scientific knowledge
* Steps of the scientific method:
1. **Make an observation**: Scientists observe a phenomenon or pattern in the natural world
2. **Ask a question**: Scientists formulate a question based on their observation
3. **Research the topic**: Scientists gather information and data related to the question
4. **Formulate a hypothesis**: Scientists propose a possible explanation for the phenomenon or pattern
5. **Design an experiment**: Scientists design an experiment to test the hypothesis
6. **Conduct the experiment**: Scientists carry out the experiment and collect data
7. **Analyze the data**: Scientists analyze the data to determine if it supports or rejects the hypothesis
8. **Draw conclusions**: Scientists draw conclusions based on the results of the experiment
9. **Communicate the results**: Scientists share their findings with others in the scientific community
**IV. The Role of the Scientific Community**
* Importance of peer review: having other scientists review and critique research findings before they are published
* Importance of replication: repeating an experiment to verify the results
* Importance of communication: sharing findings with others in the scientific community
**V. Conclusion**
* Recap of the importance of the scientific method and the role of the scientific community
* Preview of the rest of the AP Biology course
llama-3-8b-instruct
0.20  SEC TO FIRST TOKEN
120 TOKENS/SEC
455  TOKENS
3.79  SEC
Perplexity Pricing Model:
Open-Source Models

Where possible, we try to match the Hugging Face implementation.

Model Parameter Count Context Length Model Type
llama-3-8b-instruct 8B 8192 Chat Completion
llama-3-70b-instruct 70B 8192 Chat Completion
codellama-70b-instruct 70B 16384 Chat Completion
mistral-7b-instruct [1] 7B 16384 Chat Completion
mixtral-8x7b-instruct 8x7B 16384 Chat Completion
mixtral-8x22b-instruct 8x22B 16384 Chat Completion

[1] This model refers to the v0.2 release of mistral-7b-instruct.

The parameters MMLU, GPQA, MATH, and HumanEval stand for the following in benchmarking:

  • MMLU: Meaningful Machine Learning Understanding. It is a benchmark that measures a model’s understanding of machine learning concepts.
  • GPQA: General Purpose Question Answering. It is a benchmark that evaluates a model’s ability to answer general-purpose questions.
  • MATH: Mathematical Reasoning. It is a benchmark that measures a model’s ability to reason mathematically.
  • HumanEval: Human Evaluation. It is a benchmark that involves human evaluators to assess a model’s performance in various tasks.
Parameters Llama 3 8B Llama 3 70B  GPT-4
 MMLU 68.40 82.00 86.50
 GPQA 34.20 39.50 49.10
 MATH 30.00 50.40 72.20
 HumanEval 62.20 81.70 87.60
 DROP 58.40 79.70 85.40

Huggingface Models: https://huggingface.co/models

Huggingface Course: https://huggingface.co/learn/nlp-course/chapter1/1

Meta Llama4 Community License Agreement: https://huggingface.co/meta-llama/Meta-Llama-3-8B
Meta Llama 3 Version Release Date: April 18, 2024

Pricing: https://huggingface.co/pricing

Spaces Hardware: https://huggingface.co/pricing#spaces

Building something cool as a side project? We also offer community GPU grants.

Community GPU Grants: Do you have an awesome Space but need help covering the GPU hardware upgrade costs? We love helping out those with an innovative Space so please feel free to apply for a community GPU grant and see if yours makes the cut! This application can be found in your Space hardware repo settings in the lower left corner under “sleep time settings”:

Share