# xerj autoindex ~/.xerj-code/corpora/xerj-search/sonic --url http://localhost:9540 --prefix plain-probe2 --no-graph --state-dir ./state-plain2 --progress plain --progress-interval 1 --yes
autoindex: 32 scan threads, 32 index workers, 4 pdf workers, --bulk-mb 8 [cores=32 ram_total_mib=122108 ram_available_mib=60812 safe_zone_mib=45549]
autoindex: bulk HTTP request timeout: 300s
xerj-bar [????????????????????????] pct unknown | walk | eta unknown
xerj-progress phase=walk basis=none pct=unknown items=0/0 bytes=0/0 rate=unknown eta_s=unknown eta_quality=unknown since_progress_s=0.0 phase_elapsed_s=0.0 elapsed_s=0.0
autoindex: 234 files (1 MB) under ~/.xerj-code/corpora/xerj-search/sonic
autoindex: ignore rules: skipped 4 files and pruned 3 directories (contents never walked, so not counted); 2 ignore files read
autoindex: ignore rules:   hidden:dotfile — 4 files, 3 directories pruned
xerj-progress phase=hash basis=bytes pct=0.0 items=0/234 bytes=0/1246689 rate=unknown eta_s=unknown eta_quality=unknown since_progress_s=0.0 phase_elapsed_s=0.0 elapsed_s=0.0
autoindex: 2 byte-identical duplicate path(s) will reuse canonical content
  duplicate: client/examples/typed_then_raw.rs → client/examples/raw.rs
  duplicate: server/tests/common/logging.rs → core/tests/common/logging.rs
xerj-progress phase=scan basis=bytes pct=0.0 items=0/232 bytes=0/1245548 rate=unknown eta_s=unknown eta_quality=unknown since_progress_s=0.0 phase_elapsed_s=0.0 elapsed_s=0.0
phase A: sniffing + sampling 232 files with 32 threads…
phase A: 1 datasets inferred, 1 junk/skipped files
estimate: at least 0.0 s–0.0 s — a MEASURED FLOOR for client-side extraction, not a prediction of the whole run: server indexing, embedding and network time are not in it
estimate: basis — measured on this machine during phase A: 231 file(s) / 1.2 MB read end to end across 4 family/families, scheduled over 32 worker(s). Covers 1.2 MB of the 1.2 MB planned (100% of planned bytes). Client-side extraction only.
  estimate: code         194 files  980.1 KB at 1.8 MB/s measured over 194 file(s) / 980.1 KB → 0.5 s
  estimate: txt-prose     21 files  186.9 KB at 12.3 MB/s measured over 21 file(s) / 186.9 KB → 0.0 s
  estimate: yaml           3 files    7.2 KB at 5.7 MB/s measured over 3 file(s) / 7.2 KB → 0.0 s
  estimate: txt-lines     13 files   41.7 KB at 43.7 MB/s measured over 13 file(s) / 41.7 KB → 0.0 s
  estimate excludes: server-side indexing, embedding and merge time (autoindex cannot measure it without writing)
  estimate excludes: network round trips to the endpoint
  estimate excludes: relationship detection and edge writes (--no-graph removes these)
  estimate excludes: families with no end-to-end read in phase A, listed under unmeasured_families
work order: source-and-docs (214 files, 1.1 MB) → config (3 files, 7.2 KB) → bulk (13 files, 41.7 KB) → vendored (1 files, 82.2 KB) — biggest first inside each band at 32 worker(s); a file that outlasts everything above it starts first regardless of band
  source-and-docs  source code and documents — what a person searches for first
  config           configuration and small structured trees — dense, high signal per byte
  bulk             logs and plain line files — voluminous, low signal per byte
  vendored         vendored, generated or minified paths — indexed last so stopping early costs nothing you care about
gate: not triggered — the measured extraction floor 0.0 s–0.0 s is under --max-minutes 10. That is NOT a promise the run finishes in 10 minutes: server, network and embedding time are not measured before indexing starts
xerj-progress phase=prepare basis=items pct=0.0 items=0/1 bytes=0/0 rate=unknown eta_s=unknown eta_quality=unknown since_progress_s=0.0 phase_elapsed_s=0.0 elapsed_s=0.5
xerj-progress phase=snapshot basis=bytes pct=0.0 items=0/232 bytes=0/1245548 rate=unknown eta_s=unknown eta_quality=unknown since_progress_s=0.0 phase_elapsed_s=0.0 elapsed_s=0.5
xerj-progress phase=snapshot basis=bytes pct=100.0 items=232/232 bytes=1245548/1245548 rate=2404109.7 eta_s=unknown eta_quality=unknown since_progress_s=0.0 phase_elapsed_s=0.5 elapsed_s=1.0
xerj-progress phase=index basis=bytes pct=0.0 items=0/231 bytes=0/2303369 rate=unknown eta_s=unknown eta_quality=unknown since_progress_s=0.0 phase_elapsed_s=0.0 elapsed_s=1.0
xerj-progress phase=index basis=bytes pct=81.7 items=169/231 bytes=1881018/2303369 rate=1899235.6 eta_s=unknown eta_quality=unknown since_progress_s=0.0 phase_elapsed_s=1.0 elapsed_s=2.0 waiting_on=core/src/stopwords/ori.rs(1.2KB)
xerj-bar [------------------------] 0.0% | finalize-catalog | 0/1 items | eta unknown
xerj-progress phase=finalize-catalog basis=items pct=0.0 items=0/1 bytes=0/0 rate=unknown eta_s=unknown eta_quality=unknown since_progress_s=0.0 phase_elapsed_s=0.0 elapsed_s=2.5
xerj-progress phase=finalize-catalog basis=items pct=100.0 items=1/1 bytes=0/0 rate=1.9 eta_s=unknown eta_quality=unknown since_progress_s=0.0 phase_elapsed_s=0.5 elapsed_s=3.0
xerj-progress phase=finalize-refresh basis=items pct=0.0 items=0/2 bytes=0/0 rate=unknown eta_s=unknown eta_quality=unknown since_progress_s=0.0 phase_elapsed_s=0.0 elapsed_s=3.1
xerj-progress phase=finalize-verify basis=items pct=0.0 items=0/231 bytes=0/0 rate=unknown eta_s=unknown eta_quality=unknown since_progress_s=0.0 phase_elapsed_s=0.0 elapsed_s=3.1
xerj-done ok=true exit=3 reason=completed-with-junk wall=3.9s files=231 records=1663 generation=1 code_files=194 code_files_indexed=194 code_files_junked=0
