Lock file generation in hdfs using scala
0
How to lock a file in Hdfs path using scala.
So that the other process cannot access the locked file until it unlocks the file.
It need to be implemented in scala.
scala synchronization locking hdfs
edited Nov 23 '18 at 5:55
Ram Ghadiyaram
16.1k54275
asked Nov 23 '18 at 5:52
vijay
26
add a comment |
0
How to lock a file in Hdfs path using scala.
So that the other process cannot access the locked file until it unlocks the file.
It need to be implemented in scala.
scala synchronization locking hdfs
edited Nov 23 '18 at 5:55
Ram Ghadiyaram
16.1k54275
asked Nov 23 '18 at 5:52
vijay
26
Why you want to do this ? what you are trying to do ? the reason why i am asking is you can have more elegant ways to address issues. java synchronization will work well with scala. but question remains same why... ?
– Ram Ghadiyaram
Nov 23 '18 at 5:57
Maxid.txt file contains the maxbatch id in it.I want to raed the id & increment the value .At the same time another process should not increment the value .When this process gets completed i need to unlock the file.So the other process can have acess to it.
– vijay
Nov 23 '18 at 6:04
okay have you seen this?
– Ram Ghadiyaram
Nov 23 '18 at 6:09
yeah i have seeen it ...Just a way to use lock for that .txt file..Is that applicable in scala
– vijay
Nov 23 '18 at 6:42
add a comment |
0
0
0
How to lock a file in Hdfs path using scala.
So that the other process cannot access the locked file until it unlocks the file.
It need to be implemented in scala.
scala synchronization locking hdfs
edited Nov 23 '18 at 5:55
Ram Ghadiyaram
16.1k54275
asked Nov 23 '18 at 5:52
vijay
26
How to lock a file in Hdfs path using scala.
So that the other process cannot access the locked file until it unlocks the file.
It need to be implemented in scala.
scala synchronization locking hdfs
scala synchronization locking hdfs
edited Nov 23 '18 at 5:55
Ram Ghadiyaram
16.1k54275
asked Nov 23 '18 at 5:52
vijay
26
edited Nov 23 '18 at 5:55
Ram Ghadiyaram
16.1k54275
asked Nov 23 '18 at 5:52
vijay
26
edited Nov 23 '18 at 5:55
Ram Ghadiyaram
16.1k54275
edited Nov 23 '18 at 5:55
Ram Ghadiyaram
16.1k54275
edited Nov 23 '18 at 5:55
Ram Ghadiyaram
16.1k54275
16.1k54275
asked Nov 23 '18 at 5:52
vijay
26
asked Nov 23 '18 at 5:52
vijay
26
asked Nov 23 '18 at 5:52
vijay
26
26
Why you want to do this ? what you are trying to do ? the reason why i am asking is you can have more elegant ways to address issues. java synchronization will work well with scala. but question remains same why... ?
– Ram Ghadiyaram
Nov 23 '18 at 5:57
Maxid.txt file contains the maxbatch id in it.I want to raed the id & increment the value .At the same time another process should not increment the value .When this process gets completed i need to unlock the file.So the other process can have acess to it.
– vijay
Nov 23 '18 at 6:04
okay have you seen this?
– Ram Ghadiyaram
Nov 23 '18 at 6:09
yeah i have seeen it ...Just a way to use lock for that .txt file..Is that applicable in scala
– vijay
Nov 23 '18 at 6:42
add a comment |
Why you want to do this ? what you are trying to do ? the reason why i am asking is you can have more elegant ways to address issues. java synchronization will work well with scala. but question remains same why... ?
– Ram Ghadiyaram
Nov 23 '18 at 5:57
Maxid.txt file contains the maxbatch id in it.I want to raed the id & increment the value .At the same time another process should not increment the value .When this process gets completed i need to unlock the file.So the other process can have acess to it.
– vijay
Nov 23 '18 at 6:04
okay have you seen this?
– Ram Ghadiyaram
Nov 23 '18 at 6:09
yeah i have seeen it ...Just a way to use lock for that .txt file..Is that applicable in scala
– vijay
Nov 23 '18 at 6:42
Why you want to do this ? what you are trying to do ? the reason why i am asking is you can have more elegant ways to address issues. java synchronization will work well with scala. but question remains same why... ?
– Ram Ghadiyaram
Nov 23 '18 at 5:57
Why you want to do this ? what you are trying to do ? the reason why i am asking is you can have more elegant ways to address issues. java synchronization will work well with scala. but question remains same why... ?
– Ram Ghadiyaram
Nov 23 '18 at 5:57
Maxid.txt file contains the maxbatch id in it.I want to raed the id & increment the value .At the same time another process should not increment the value .When this process gets completed i need to unlock the file.So the other process can have acess to it.
– vijay
Nov 23 '18 at 6:04
Maxid.txt file contains the maxbatch id in it.I want to raed the id & increment the value .At the same time another process should not increment the value .When this process gets completed i need to unlock the file.So the other process can have acess to it.
– vijay
Nov 23 '18 at 6:04
okay have you seen this?
– Ram Ghadiyaram
Nov 23 '18 at 6:09
okay have you seen this?
– Ram Ghadiyaram
Nov 23 '18 at 6:09
yeah i have seeen it ...Just a way to use lock for that .txt file..Is that applicable in scala
– vijay
Nov 23 '18 at 6:42
yeah i have seeen it ...Just a way to use lock for that .txt file..Is that applicable in scala
– vijay
Nov 23 '18 at 6:42
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
draft saved
draft discarded
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53441264%2flock-file-generation-in-hdfs-using-scala%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
draft saved
draft discarded
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
draft saved
draft discarded
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53441264%2flock-file-generation-in-hdfs-using-scala%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Why you want to do this ? what you are trying to do ? the reason why i am asking is you can have more elegant ways to address issues. java synchronization will work well with scala. but question remains same why... ?
– Ram Ghadiyaram
Nov 23 '18 at 5:57
Maxid.txt file contains the maxbatch id in it.I want to raed the id & increment the value .At the same time another process should not increment the value .When this process gets completed i need to unlock the file.So the other process can have acess to it.
– vijay
Nov 23 '18 at 6:04
okay have you seen this?
– Ram Ghadiyaram
Nov 23 '18 at 6:09
yeah i have seeen it ...Just a way to use lock for that .txt file..Is that applicable in scala
– vijay
Nov 23 '18 at 6:42