gitea/models
Bruno Sofiato 900ac62251
Allow code search by filename (#32210)
This is a large and complex PR, so let me explain in detail its changes.

First, I had to create new index mappings for Bleve and ElasticSerach as
the current ones do not support search by filename. This requires Gitea
to recreate the code search indexes (I do not know if this is a breaking
change, but I feel it deserves a heads-up).

I've used [this
approach](https://www.elastic.co/guide/en/elasticsearch/reference/7.17/analysis-pathhierarchy-tokenizer.html)
to model the filename index. It allows us to efficiently search for both
the full path and the name of a file. Bleve, however, does not support
this out-of-box, so I had to code a brand new [token
filter](https://blevesearch.com/docs/Token-Filters/) to generate the
search terms.

I also did an overhaul in the `indexer_test.go` file. It now asserts the
order of the expected results (this is important since matches based on
the name of a file are more relevant than those based on its content).
I've added new test scenarios that deal with searching by filename. They
use a new repo included in the Gitea fixture.

The screenshot below depicts how Gitea shows the search results. It
shows results based on content in the same way as the current version
does. In matches based on the filename, the first seven lines of the
file contents are shown (BTW, this is how GitHub does it).


![image](https://github.com/user-attachments/assets/9d938d86-1a8d-4f89-8644-1921a473e858)

Resolves #32096

---------

Signed-off-by: Bruno Sofiato <bruno.sofiato@gmail.com>
2024-10-11 23:35:04 +00:00
..
actions Show latest run when visit /run/latest (#31808) 2024-08-10 08:40:41 +08:00
activities Don't join repository when loading action table data (#32127) 2024-09-26 04:50:30 +00:00
admin Fix javascript error when an anonymous user visiting migration page (#32144) 2024-10-02 04:37:16 +00:00
asymkey bump to go 1.23 (#31855) 2024-09-10 02:23:07 +00:00
auth Fix nuget/conan/container packages upload bugs (#31967) 2024-09-05 07:05:42 +00:00
avatars Replace 10 more gt- classes with tw- (#29945) 2024-03-22 13:45:10 +00:00
db bump to go 1.23 (#31855) 2024-09-10 02:23:07 +00:00
dbfs Enable unparam linter (#31277) 2024-06-11 18:47:45 +00:00
fixtures Allow code search by filename (#32210) 2024-10-11 23:35:04 +00:00
git Show lock owner instead of repo owner on LFS setting page (#31788) 2024-08-11 14:48:20 +00:00
issues Allow filtering PRs by poster in the ListPullRequests API (#32209) 2024-10-07 23:21:07 +02:00
migrations Support repo license (#24872) 2024-10-01 15:25:08 -04:00
organization Add option to filter board cards by labels and assignees (#31999) 2024-09-12 03:53:40 +00:00
packages Fix package list performance (#30520) 2024-04-20 13:07:00 +02:00
perm Clarify permission "HasAccess" behavior (#30585) 2024-04-20 03:15:04 +00:00
project Fixes for unreachable project issues when transfer repository from organization (#31770) 2024-08-13 02:53:43 +00:00
pull Add support for sha256 repositories (#23894) 2024-01-19 17:05:02 +01:00
repo Allow code search by filename (#32210) 2024-10-11 23:35:04 +00:00
secret Clarify Actions resources ownership (#31724) 2024-08-01 09:04:04 +00:00
shared/types Refactor locale&string&template related code (#29165) 2024-02-14 21:48:45 +00:00
system Refactor deletion (#28610) 2023-12-25 21:25:29 +01:00
unit Refactor repo unit "disabled" check (#31389) 2024-06-18 00:51:13 +00:00
unittest Add some tests to clarify the "must-change-password" behavior (#30693) 2024-04-27 12:23:37 +00:00
user Allow code search by filename (#32210) 2024-10-11 23:35:04 +00:00
webhook Store webhook event in database (#29145) 2024-03-07 23:18:38 +01:00
error.go Add merge style fast-forward-only (#28954) 2024-02-12 23:37:23 +01:00
fixture_generation.go Replace more db.DefaultContext (#27628) 2023-10-15 17:46:06 +02:00
fixture_test.go Replace more db.DefaultContext (#27628) 2023-10-15 17:46:06 +02:00
main_test.go make writing main test easier (#27270) 2023-09-28 01:38:53 +00:00
org_team_test.go Add user blocking (#29028) 2024-03-04 08:16:03 +00:00
org_team.go Clarify permission "HasAccess" behavior (#30585) 2024-04-20 03:15:04 +00:00
org_test.go Add user blocking (#29028) 2024-03-04 08:16:03 +00:00
org.go Add user blocking (#29028) 2024-03-04 08:16:03 +00:00
repo_test.go Penultimate round of db.DefaultContext refactor (#27414) 2023-10-11 04:24:07 +00:00
repo_transfer.go chore: use errors.New to replace fmt.Errorf with no parameters will much better (#30621) 2024-04-21 19:44:03 +00:00
repo.go Refactor deletion (#28610) 2023-12-25 21:25:29 +01:00