2026-04-11 09:28:44 - __main__ - INFO - ============================================================ 2026-04-11 09:28:44 - __main__ - INFO - ImdbUpdate v2 - Avvio (DuckDB pipeline) 2026-04-11 09:28:44 - __main__ - INFO - ============================================================ 2026-04-11 09:28:44 - __main__ - INFO - Base directory: C:\PYTHON\ImdbUpdate 2026-04-11 09:28:44 - __main__ - INFO - Temp directory: C:\PYTHON\ImdbUpdate\Temp 2026-04-11 09:28:44 - __main__ - INFO - Parquet output: C:\PYTHON\ImdbUpdate\parquet\imdb.parquet 2026-04-11 09:28:44 - __main__ - INFO - Preparazione directory temporanea 2026-04-11 09:28:44 - __main__ - INFO - Directory creata: C:\PYTHON\ImdbUpdate\Temp 2026-04-11 09:28:44 - __main__ - INFO - ============================================================ 2026-04-11 09:28:44 - __main__ - INFO - FASE 2: Download dataset IMDb 2026-04-11 09:28:44 - __main__ - INFO - ============================================================ 2026-04-11 09:28:44 - src.downloader - INFO - Download name_basics.tsv.gz da https://datasets.imdbws.com/name.basics.tsv.gz 2026-04-11 09:29:29 - src.downloader - INFO - Download completato: C:\PYTHON\ImdbUpdate\Temp\name_basics.tsv.gz 2026-04-11 09:29:29 - src.downloader - INFO - Decompressione name_basics.tsv.gz -> name_basics.tsv 2026-04-11 09:29:36 - src.downloader - INFO - Decompressione completata: C:\PYTHON\ImdbUpdate\Temp\name_basics.tsv 2026-04-11 09:29:36 - src.downloader - INFO - Rinominato name_basics.tsv -> name_basics.txt 2026-04-11 09:29:36 - src.downloader - INFO - Download title_akas.tsv.gz da https://datasets.imdbws.com/title.akas.tsv.gz 2026-04-11 09:30:49 - src.downloader - INFO - Download completato: C:\PYTHON\ImdbUpdate\Temp\title_akas.tsv.gz 2026-04-11 09:30:49 - src.downloader - INFO - Decompressione title_akas.tsv.gz -> title_akas.tsv 2026-04-11 09:31:01 - src.downloader - INFO - Decompressione completata: C:\PYTHON\ImdbUpdate\Temp\title_akas.tsv 2026-04-11 09:31:01 - src.downloader - INFO - Rinominato title_akas.tsv -> title_akas.txt 2026-04-11 09:31:01 - src.downloader - INFO - Download title_basics.tsv.gz da https://datasets.imdbws.com/title.basics.tsv.gz 2026-04-11 09:31:32 - src.downloader - INFO - Download completato: C:\PYTHON\ImdbUpdate\Temp\title_basics.tsv.gz 2026-04-11 09:31:32 - src.downloader - INFO - Decompressione title_basics.tsv.gz -> title_basics.tsv 2026-04-11 09:31:37 - src.downloader - INFO - Decompressione completata: C:\PYTHON\ImdbUpdate\Temp\title_basics.tsv 2026-04-11 09:31:37 - src.downloader - INFO - Rinominato title_basics.tsv -> title_basics.txt 2026-04-11 09:31:37 - src.downloader - INFO - Download title_crew.tsv.gz da https://datasets.imdbws.com/title.crew.tsv.gz 2026-04-11 09:31:50 - src.downloader - INFO - Download completato: C:\PYTHON\ImdbUpdate\Temp\title_crew.tsv.gz 2026-04-11 09:31:50 - src.downloader - INFO - Decompressione title_crew.tsv.gz -> title_crew.tsv 2026-04-11 09:31:52 - src.downloader - INFO - Decompressione completata: C:\PYTHON\ImdbUpdate\Temp\title_crew.tsv 2026-04-11 09:31:52 - src.downloader - INFO - Rinominato title_crew.tsv -> title_crew.txt 2026-04-11 09:31:52 - src.downloader - INFO - Download title_episode.tsv.gz da https://datasets.imdbws.com/title.episode.tsv.gz 2026-04-11 09:31:59 - src.downloader - INFO - Download completato: C:\PYTHON\ImdbUpdate\Temp\title_episode.tsv.gz 2026-04-11 09:31:59 - src.downloader - INFO - Decompressione title_episode.tsv.gz -> title_episode.tsv 2026-04-11 09:32:01 - src.downloader - INFO - Decompressione completata: C:\PYTHON\ImdbUpdate\Temp\title_episode.tsv 2026-04-11 09:32:01 - src.downloader - INFO - Rinominato title_episode.tsv -> title_episode.txt 2026-04-11 09:32:01 - src.downloader - INFO - Download title_principals.tsv.gz da https://datasets.imdbws.com/title.principals.tsv.gz 2026-04-11 09:33:50 - src.downloader - INFO - Download completato: C:\PYTHON\ImdbUpdate\Temp\title_principals.tsv.gz 2026-04-11 09:33:50 - src.downloader - INFO - Decompressione title_principals.tsv.gz -> title_principals.tsv 2026-04-11 09:34:09 - src.downloader - INFO - Decompressione completata: C:\PYTHON\ImdbUpdate\Temp\title_principals.tsv 2026-04-11 09:34:09 - src.downloader - INFO - Rinominato title_principals.tsv -> title_principals.txt 2026-04-11 09:34:09 - src.downloader - INFO - Download title_ratings.tsv.gz da https://datasets.imdbws.com/title.ratings.tsv.gz 2026-04-11 09:34:12 - src.downloader - INFO - Download completato: C:\PYTHON\ImdbUpdate\Temp\title_ratings.tsv.gz 2026-04-11 09:34:12 - src.downloader - INFO - Decompressione title_ratings.tsv.gz -> title_ratings.tsv 2026-04-11 09:34:12 - src.downloader - INFO - Decompressione completata: C:\PYTHON\ImdbUpdate\Temp\title_ratings.tsv 2026-04-11 09:34:12 - src.downloader - INFO - Rinominato title_ratings.tsv -> title_ratings.txt 2026-04-11 09:34:12 - src.downloader - INFO - Processati 7/7 file 2026-04-11 09:34:12 - __main__ - INFO - Download completato: 7 file 2026-04-11 09:34:12 - __main__ - INFO - ============================================================ 2026-04-11 09:34:12 - __main__ - INFO - FASE 3: Transform DuckDB → imdb.parquet 2026-04-11 09:34:12 - __main__ - INFO - ============================================================ 2026-04-11 09:34:12 - src.transformer - INFO - Caricamento title_basics: title_basics.txt 2026-04-11 09:34:14 - src.transformer - INFO - title_basics: 1,264,057 righe (filtrate per titleType) 2026-04-11 09:34:14 - src.transformer - INFO - Caricamento title_akas: title_akas.txt 2026-04-11 09:34:17 - src.transformer - INFO - title_akas: 5,321,724 righe (solo region=IT) 2026-04-11 09:34:17 - src.transformer - INFO - Caricamento title_ratings: title_ratings.txt 2026-04-11 09:34:18 - src.transformer - INFO - title_ratings: 1,658,155 righe 2026-04-11 09:34:18 - src.transformer - INFO - Caricamento title_principals: title_principals.txt 2026-04-11 09:34:24 - src.transformer - INFO - title_principals: 31,768,337 righe (director+actor) 2026-04-11 09:34:24 - src.transformer - INFO - Caricamento name_basics: name_basics.txt 2026-04-11 09:34:26 - src.transformer - INFO - name_basics: 15,225,343 righe 2026-04-11 09:34:26 - src.transformer - INFO - Caricamento OTT da: \\mediaset.it\share\Indirizzo_Controllo_risorse\SOFTWARE\ProcedureICR\ICRmonitor\MonitorLinker\db_split_OTT.accdb 2026-04-11 09:35:25 - src.transformer - WARNING - OTT non raggiungibile: ('HY024', "[HY024] [Microsoft][Driver ODBC Microsoft Access] '(sconosciuto)' non è un percorso valido. Assicurarsi che il nome del percorso sia corretto e di essere connessi al server in cui si trova il file. (-1023) (SQLDriverConnect); [HY024] [Microsoft][Driver ODBC Microsoft Access] '(sconosciuto)' non è un percorso valido. Assicurarsi che il nome del percorso sia corretto e di essere connessi al server in cui si trova il file. (-1023)") 2026-04-11 09:35:25 - src.transformer - WARNING - OTT_EMESSO = NULL per tutti i titoli (non bloccante) 2026-04-11 09:35:25 - src.transformer - INFO - Costruzione new_imdb via CTE DuckDB... 2026-04-11 09:35:49 - __main__ - ERROR - Errore fatale: Out of Memory Error: failed to allocate data of size 16.0 MiB (3.7 GiB/3.7 GiB used) Possible solutions: * Reducing the number of threads (SET threads=X) * Disabling insertion-order preservation (SET preserve_insertion_order=false) * Increasing the memory limit (SET memory_limit='...GB') See also https://duckdb.org/docs/stable/guides/performance/how_to_tune_workloads Traceback (most recent call last): File "C:\PYTHON\ImdbUpdate\main.py", line 253, in main if not transform_and_export_parquet(files): ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\PYTHON\ImdbUpdate\main.py", line 86, in transform_and_export_parquet row_count = transformer.transform(files) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\PYTHON\ImdbUpdate\src\transformer.py", line 56, in transform self._build_new_imdb() File "C:\PYTHON\ImdbUpdate\src\transformer.py", line 174, in _build_new_imdb self._con.execute(f""" _duckdb.OutOfMemoryException: Out of Memory Error: failed to allocate data of size 16.0 MiB (3.7 GiB/3.7 GiB used) Possible solutions: * Reducing the number of threads (SET threads=X) * Disabling insertion-order preservation (SET preserve_insertion_order=false) * Increasing the memory limit (SET memory_limit='...GB') See also https://duckdb.org/docs/stable/guides/performance/how_to_tune_workloads