.. _sphx_glr_auto_examples_pitfalls_and_solutions:

Checking for modeling pitfalls and remediation
----------------------------------------------

Examples for each automated check. Each script reproduces a check, and walks
through fixes described in :ref:`automated_checks`.


.. raw:: html

  <div id='sg-tag-list' class='sphx-glr-tag-list'></div>


.. raw:: html

    <div class="sphx-glr-thumbnails">

.. thumbnail-parent-div-open

.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="skd002-underfitting and skd001-overfitting describe opposite ends of the same problem: model expressiveness.">

.. only:: html

  .. image:: /auto_examples/pitfalls_and_solutions/images/thumb/sphx_glr_plot_skd001_skd002_overfitting_underfitting_thumb.png
    :alt:

  :doc:`/auto_examples/pitfalls_and_solutions/plot_skd001_skd002_overfitting_underfitting`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">SKD001 & SKD002 - Overfitting and underfitting</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="skd004-high-class-imbalance flags a binary classification task when the majority class exceeds 80 % of rows. Accuracy can look high while the minority class is ignored as a default. This notebook is mostly about how to work with that imbalance once the check fires: we do not try to make SKD004 disappear, because natural prevalence is often the right thing to keep.">

.. only:: html

  .. image:: /auto_examples/pitfalls_and_solutions/images/thumb/sphx_glr_plot_skd004_high_class_imbalance_thumb.png
    :alt:

  :doc:`/auto_examples/pitfalls_and_solutions/plot_skd004_high_class_imbalance`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">SKD004 - High class imbalance</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="This example walks through mitigations when checks skd014-hyperparams-at-search-edge and skd015-hyperparameters-worth-tuning fire on a fitted search object. SKD014 is an issue: numeric best_params_ sit on the minimum or maximum value tried, so the true optimum may lie outside the searched range. SKD015 is a tip: a hyperparameter is missing from the search space, which is incomplete rather than necessarily wrong.">

.. only:: html

  .. image:: /auto_examples/pitfalls_and_solutions/images/thumb/sphx_glr_plot_skd014_skd015_hyperparameter_search_thumb.png
    :alt:

  :doc:`/auto_examples/pitfalls_and_solutions/plot_skd014_skd015_hyperparameter_search`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">SKD014 & SKD015: Hyperparameter search pitfalls</div>
    </div>


.. thumbnail-parent-div-close

.. raw:: html

    </div>


.. toctree::
   :hidden:

   /auto_examples/pitfalls_and_solutions/plot_skd001_skd002_overfitting_underfitting
   /auto_examples/pitfalls_and_solutions/plot_skd004_high_class_imbalance
   /auto_examples/pitfalls_and_solutions/plot_skd014_skd015_hyperparameter_search