Advances in machine learning (ML) have opened up new possibilities for accurate predictions in various fields. To ensure the reliability of these predictions, especially in high-stakes decision-making scenarios, theory and tools need to be developed that provide confidence intervals. This research project aims to create innovative methods for quantifying uncertainty in complex systems, allowing for more informed and confident decision-making. One key aspect of this work is designing efficient collaboration between humans and machines, where artificial intelligence (AI) produces a set of possible solutions and human experts select the best option. For instance, in medical diagnosis, these tools will enable doctors to identify potential health risks by generating a short list of likely diagnoses, with the correct answer guaranteed to be included among them. Through a five-year program combining cutting-edge research, education, and community engagement, the researcher will develop novel algorithmic and theoretical frameworks to improve predictive accuracy and trustworthiness across various applications. To share the results broadly, the researcher will publish research papers, present at conferences, and provide tutorials on uncertainty quantification and safe ML deployment. This project aims to create a new framework that seamlessly integrates conformal prediction principles into ML model training procedures. This integrated approach will enable the production of small unc