tiny.chant.surveyTokens

Defined in tiny.chant.

Source

Source: lib/chant/src/lexer/stream.zig:191

1pub fn survey(2    source: []const u8,3    file: []const u8,4) (chant.lexer.Error || Exhaustion)!Survey {5    var lexer = state.Lexer.init(source, file);6    var token_count: usize = 0;7    while (true) {8        const tok = try scan.next(&lexer);9        token_count = std.math.add(usize, token_count, 1) catch10            return error.TokenCapacityExceeded;11        if (tok.kind == .eof) break;12    }13    return .{14        .source_ptr = source.ptr,15        .source_len = source.len,16        .file_ptr = file.ptr,17        .file_len = file.len,18        .limits = .{ .tokens = token_count },19    };20}

Source: lib/chant/src/root.zig:77

1pub const surveyTokens = lexer.survey;

Also reachable as

lexer.survey.

Complete caller list

7 direct callers.

• lib.chant.src.lexer.stream.initFailures [function] — private source at lib/chant/src/lexer/stream.zig:224 in nearest public owner lib.chant.src.lexer.stream
• lib.chant.src.lexer.stream.test_activated_token_storage_fills_cold_without_allocation [function] — test source at lib/chant/src/lexer/stream.zig:359 in nearest public owner lib.chant.src.lexer.stream
• lib.chant.src.lexer.stream.test_token_fill_requires_the_surveyed_source_identity [function] — test source at lib/chant/src/lexer/stream.zig:318 in nearest public owner lib.chant.src.lexer.stream
• lib.chant.src.lexer.stream.test_token_storage_accepts_max_and_rejects_max_plus_one_before_mutation [function] — test source at lib/chant/src/lexer/stream.zig:256 in nearest public owner lib.chant.src.lexer.stream
• lib.chant.src.lexer.stream.test_token_survey_and_fill_match_direct_lexing [function] — test source at lib/chant/src/lexer/stream.zig:410 in nearest public owner lib.chant.src.lexer.stream
• lib.chant.src.lexer.stream.test_token_survey_preserves_deterministic_lexer_errors [function] — test source at lib/chant/src/lexer/stream.zig:455 in nearest public owner lib.chant.src.lexer.stream
• lib.chant.src.lexer.stream.test_zero_token_capacity_owns_no_bytes_and_rejects_the_first_token [function] — test source at lib/chant/src/lexer/stream.zig:302 in nearest public owner lib.chant.src.lexer.stream

Audit