Measure

Measure things about data.

def byte_size(data)

Measure the size of data.

Works for numpy-arrays, pandas DataFrames and Series, and iterables of any of these.

PARAMETER	DESCRIPTION
data	The data to measure. TYPE: Any | Iterable[Any]

RETURNS	DESCRIPTION
int	The size of the data.

Source code in src/amltk/data/measure.py

def byte_size(data: Any | Iterable[Any]) -> int:
    """Measure the size of data.

    Works for numpy-arrays, pandas DataFrames and Series, and iterables of any of
    these.

    Args:
        data: The data to measure.

    Returns:
        The size of the data.
    """
    if isinstance(data, np.ndarray):
        return data.nbytes
    if isinstance(data, pd.DataFrame):
        return int(data.memory_usage(deep=True).sum())
    if isinstance(data, pd.Series):
        return int(data.memory_usage(deep=True))
    if isinstance(data, str):
        return sys.getsizeof(data)
    if isinstance(data, Iterable):
        return sum(byte_size(d) for d in data)

    return sys.getsizeof(data)