Apache lucene: Sorting numbers and german umlauts
Is there a option in Apache lucene to sort numbers and german umlauts correctly which means, e.g.
"Ü" should be interpreted as "Ue", which means that the sort order is
U, Ü, Z
and not:
U, Z, Ü
like the lucene default.
Sorting numbers like
1, 2, 3, 100, 101, 102
and not like the lucene default:
1, 100, 101, 102, 2, 3
How can I solve the entries in that way?
Thank you!
java apache lucene
asked Nov 22 '18 at 22:00
Chr.14
84
add a comment |
Is there a option in Apache lucene to sort numbers and german umlauts correctly which means, e.g.
"Ü" should be interpreted as "Ue", which means that the sort order is
U, Ü, Z
and not:
U, Z, Ü
like the lucene default.
Sorting numbers like
1, 2, 3, 100, 101, 102
and not like the lucene default:
1, 100, 101, 102, 2, 3
How can I solve the entries in that way?
Thank you!
java apache lucene
asked Nov 22 '18 at 22:00
Chr.14
84
add a comment |
Is there a option in Apache lucene to sort numbers and german umlauts correctly which means, e.g.
"Ü" should be interpreted as "Ue", which means that the sort order is
U, Ü, Z
and not:
U, Z, Ü
like the lucene default.
Sorting numbers like
1, 2, 3, 100, 101, 102
and not like the lucene default:
1, 100, 101, 102, 2, 3
How can I solve the entries in that way?
Thank you!
java apache lucene
asked Nov 22 '18 at 22:00
Chr.14
84
Is there a option in Apache lucene to sort numbers and german umlauts correctly which means, e.g.
"Ü" should be interpreted as "Ue", which means that the sort order is
U, Ü, Z
and not:
U, Z, Ü
like the lucene default.
Sorting numbers like
1, 2, 3, 100, 101, 102
and not like the lucene default:
1, 100, 101, 102, 2, 3
How can I solve the entries in that way?
Thank you!
java apache lucene
java apache lucene
asked Nov 22 '18 at 22:00
Chr.14
84
asked Nov 22 '18 at 22:00
Chr.14
84
asked Nov 22 '18 at 22:00
Chr.14
84
asked Nov 22 '18 at 22:00
Chr.14
84
asked Nov 22 '18 at 22:00
Chr.14
84
84
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
Yes, it is possible. First about German language, best way to deal with language in Lucene is to use ICU library. For the Lucene we have corresponding lucene-analyzers-icu dependency.
You could use ICUCollationDocValuesField for sorting of the values.
final Collator instance = Collator.getInstance(ULocale.GERMAN);
final ICUCollationDocValuesField contents = new ICUCollationDocValuesField("contents", instance);
Later using this field to create a documents you will be able later to sort on this field and got expected results (e.g. U, Ü, Z)
Full working example could be found there
Regarding sorting of numbers - you just need to sort them not as strings (which it looks like you're doing), but actually sort them as a numbers SortField.Type.INT should help you with this
answered Dec 18 '18 at 16:22
Mysterion
5,90221942
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53438426%2fapache-lucene-sorting-numbers-and-german-umlauts%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
Yes, it is possible. First about German language, best way to deal with language in Lucene is to use ICU library. For the Lucene we have corresponding lucene-analyzers-icu dependency.
You could use ICUCollationDocValuesField for sorting of the values.
final Collator instance = Collator.getInstance(ULocale.GERMAN);
final ICUCollationDocValuesField contents = new ICUCollationDocValuesField("contents", instance);
Later using this field to create a documents you will be able later to sort on this field and got expected results (e.g. U, Ü, Z)
Full working example could be found there
Regarding sorting of numbers - you just need to sort them not as strings (which it looks like you're doing), but actually sort them as a numbers SortField.Type.INT should help you with this
answered Dec 18 '18 at 16:22
Mysterion
5,90221942
add a comment |
Yes, it is possible. First about German language, best way to deal with language in Lucene is to use ICU library. For the Lucene we have corresponding lucene-analyzers-icu dependency.
You could use ICUCollationDocValuesField for sorting of the values.
final Collator instance = Collator.getInstance(ULocale.GERMAN);
final ICUCollationDocValuesField contents = new ICUCollationDocValuesField("contents", instance);
Later using this field to create a documents you will be able later to sort on this field and got expected results (e.g. U, Ü, Z)
Full working example could be found there
Regarding sorting of numbers - you just need to sort them not as strings (which it looks like you're doing), but actually sort them as a numbers SortField.Type.INT should help you with this
answered Dec 18 '18 at 16:22
Mysterion
5,90221942
add a comment |
Yes, it is possible. First about German language, best way to deal with language in Lucene is to use ICU library. For the Lucene we have corresponding lucene-analyzers-icu dependency.
You could use ICUCollationDocValuesField for sorting of the values.
final Collator instance = Collator.getInstance(ULocale.GERMAN);
final ICUCollationDocValuesField contents = new ICUCollationDocValuesField("contents", instance);
Later using this field to create a documents you will be able later to sort on this field and got expected results (e.g. U, Ü, Z)
Full working example could be found there
Regarding sorting of numbers - you just need to sort them not as strings (which it looks like you're doing), but actually sort them as a numbers SortField.Type.INT should help you with this
answered Dec 18 '18 at 16:22
Mysterion
5,90221942
Yes, it is possible. First about German language, best way to deal with language in Lucene is to use ICU library. For the Lucene we have corresponding lucene-analyzers-icu dependency.
You could use ICUCollationDocValuesField for sorting of the values.
final Collator instance = Collator.getInstance(ULocale.GERMAN);
final ICUCollationDocValuesField contents = new ICUCollationDocValuesField("contents", instance);
Later using this field to create a documents you will be able later to sort on this field and got expected results (e.g. U, Ü, Z)
Full working example could be found there
Regarding sorting of numbers - you just need to sort them not as strings (which it looks like you're doing), but actually sort them as a numbers SortField.Type.INT should help you with this
answered Dec 18 '18 at 16:22
Mysterion
5,90221942
answered Dec 18 '18 at 16:22
Mysterion
5,90221942
answered Dec 18 '18 at 16:22
Mysterion
5,90221942
answered Dec 18 '18 at 16:22
Mysterion
5,90221942
5,90221942
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53438426%2fapache-lucene-sorting-numbers-and-german-umlauts%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
