Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
37 commits
Select commit Hold shift + click to select a range
b8b3fdb
support [2, 3] in make_cue_matrix
shanshanxu33 Oct 19, 2024
74279b8
Add make_combined_pS_matrix
shanshanxu33 Oct 19, 2024
417f908
support [2, 3] in make_cue_matrix
shanshanxu33 Oct 19, 2024
0aa8dfb
support [2, 3] in make_cue_matrix
shanshanxu33 Oct 19, 2024
84d4ab8
simple version
shanshanxu33 Oct 19, 2024
b88aca0
simple version
shanshanxu33 Oct 19, 2024
4c2d38c
Enables the use of multiple n-grams
shanshanxu33 Oct 19, 2024
0621c85
Update rownames assignment to repeat target_col based on grams length
shanshanxu33 Oct 20, 2024
6dd1fc2
Expand frequencies according to the number of n-grams
shanshanxu33 Oct 20, 2024
b092304
Expand frequencies according to the number of n-grams
shanshanxu33 Oct 20, 2024
c6646b7
Revert to original code
shanshanxu33 Oct 20, 2024
e936775
Implement intermediate buffer for n-gram generation
shanshanxu33 Oct 22, 2024
d23780a
Simplify `m` calculation to always use data row size
shanshanxu33 Oct 22, 2024
388831d
Remove repetition in `rownames` assignment
shanshanxu33 Oct 22, 2024
0a65313
Simplify m calculation to always use data row size
shanshanxu33 Oct 22, 2024
d18dac6
not strictly necessary
shanshanxu33 Oct 28, 2024
452686a
formatting
shanshanxu33 Oct 28, 2024
e3ed485
Modify other functions
shanshanxu33 Oct 31, 2024
7c903c0
set A to nothing
shanshanxu33 Nov 5, 2024
47375f2
Modify type to Nothing
shanshanxu33 Nov 5, 2024
d68a94b
Delete Duplicate
shanshanxu33 Nov 5, 2024
5f7c974
Modified to support combined n-grams
shanshanxu33 Nov 6, 2024
4d7bcf7
Maintain code consistency
shanshanxu33 Nov 6, 2024
01663ab
update ngram logic
shanshanxu33 Nov 6, 2024
c232d99
Keep the code consistent
shanshanxu33 Nov 6, 2024
f6aedc8
fix the BoundsError
shanshanxu33 Nov 7, 2024
1834624
go back
shanshanxu33 Nov 7, 2024
74abf2c
Fix embeddings loading
shanshanxu33 Nov 15, 2024
7da0df9
go back
shanshanxu33 Nov 15, 2024
02ee683
Fix multi-word phrase handling
shanshanxu33 Apr 10, 2025
d698665
Merge branch 'master' of github.com:shanshanxu33/JudiLing.jl
shanshanxu33 Apr 10, 2025
b46bb30
go back
shanshanxu33 Apr 10, 2025
05dd51b
fix: add padding for tokens shorter than n in make_ngrams
shanshanxu33 Aug 26, 2025
bf409fd
Update Julia version to 1.11
shanshanxu33 Sep 2, 2025
75c7f95
Resolved merge conflict using upstream/master version
shanshanxu33 Nov 11, 2025
b6422ec
modify make_cue_matrix to handle empty start_end_token
shanshanxu33 Mar 8, 2026
43229da
Merge branch 'backup-master' # Please enter a commit message to explain
shanshanxu33 Mar 8, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion src/cholesky.jl
Original file line number Diff line number Diff line change
Expand Up @@ -406,4 +406,4 @@ function format_matrix(
return Array(M)
end
end
end
end
2 changes: 1 addition & 1 deletion src/input.jl
Original file line number Diff line number Diff line change
Expand Up @@ -212,7 +212,7 @@ function loading_data_careful_split(
n_grams_target_col::Union{Symbol, String} = :Word,
n_grams_tokenized::Bool = false,
n_grams_sep_token::Union{Nothing, String} = nothing,
grams::Int = 3,
grams::Union{Vector{Int64}, Int64}=[3],
n_grams_keep_sep::Bool = false,
start_end_token::String = "#",
random_seed::Int = 314,
Expand Down
Loading