Big int values from oracle sql database become negative after reading sql in df with pandas
I have some big numbers like 12341567899 in oracle database in column1. I use python to read the data to df.
df = pd.read_sql(query, connection)
after this I get my int values as negative ones. I understand that the problem is with dtype int overflow, so i tried to write to_char(column1) and get all big numbers as strings. But this makes my query very slow. How can I deal with this problem? Thanks.
python oracle pandas
asked Nov 23 '18 at 10:38
Михаил ЕлизаровМихаил Елизаров
12
add a comment |
I have some big numbers like 12341567899 in oracle database in column1. I use python to read the data to df.
df = pd.read_sql(query, connection)
after this I get my int values as negative ones. I understand that the problem is with dtype int overflow, so i tried to write to_char(column1) and get all big numbers as strings. But this makes my query very slow. How can I deal with this problem? Thanks.
python oracle pandas
asked Nov 23 '18 at 10:38
Михаил ЕлизаровМихаил Елизаров
12
Which version of Python are you using?sys.maxsizereturns9223372036854775807for me.
– Glazbee
Nov 23 '18 at 10:45
I am using python 3.6.2
– Михаил Елизаров
Nov 23 '18 at 10:47
I would recommend running Python in 64-bit. 32-bit Python returnssys.maxsizeas2147483647, this is where you're running into errors.
– Glazbee
Nov 23 '18 at 10:49
I have 64-bit python. sys.maxsize returns9223372036854775807
– Михаил Елизаров
Nov 23 '18 at 10:51
I suppose you're usingconnection = cx_Oracle.connect('username/pwd@DBdns:1521/DBsid'), aren't you ..?
– Barbaros Özhan
Nov 24 '18 at 22:41
add a comment |
I have some big numbers like 12341567899 in oracle database in column1. I use python to read the data to df.
df = pd.read_sql(query, connection)
after this I get my int values as negative ones. I understand that the problem is with dtype int overflow, so i tried to write to_char(column1) and get all big numbers as strings. But this makes my query very slow. How can I deal with this problem? Thanks.
python oracle pandas
asked Nov 23 '18 at 10:38
Михаил ЕлизаровМихаил Елизаров
12
I have some big numbers like 12341567899 in oracle database in column1. I use python to read the data to df.
df = pd.read_sql(query, connection)
after this I get my int values as negative ones. I understand that the problem is with dtype int overflow, so i tried to write to_char(column1) and get all big numbers as strings. But this makes my query very slow. How can I deal with this problem? Thanks.
python oracle pandas
python oracle pandas
asked Nov 23 '18 at 10:38
Михаил ЕлизаровМихаил Елизаров
12
asked Nov 23 '18 at 10:38
Михаил ЕлизаровМихаил Елизаров
12
edited Nov 23 '18 at 10:43
Михаил Елизаров
asked Nov 23 '18 at 10:38
Михаил ЕлизаровМихаил Елизаров
12
asked Nov 23 '18 at 10:38
Михаил ЕлизаровМихаил Елизаров
12
asked Nov 23 '18 at 10:38
Михаил ЕлизаровМихаил Елизаров
12
12
Which version of Python are you using?sys.maxsizereturns9223372036854775807for me.
– Glazbee
Nov 23 '18 at 10:45
I am using python 3.6.2
– Михаил Елизаров
Nov 23 '18 at 10:47
I would recommend running Python in 64-bit. 32-bit Python returnssys.maxsizeas2147483647, this is where you're running into errors.
– Glazbee
Nov 23 '18 at 10:49
I have 64-bit python. sys.maxsize returns9223372036854775807
– Михаил Елизаров
Nov 23 '18 at 10:51
I suppose you're usingconnection = cx_Oracle.connect('username/pwd@DBdns:1521/DBsid'), aren't you ..?
– Barbaros Özhan
Nov 24 '18 at 22:41
add a comment |
Which version of Python are you using?sys.maxsizereturns9223372036854775807for me.
– Glazbee
Nov 23 '18 at 10:45
I am using python 3.6.2
– Михаил Елизаров
Nov 23 '18 at 10:47
I would recommend running Python in 64-bit. 32-bit Python returnssys.maxsizeas2147483647, this is where you're running into errors.
– Glazbee
Nov 23 '18 at 10:49
I have 64-bit python. sys.maxsize returns9223372036854775807
– Михаил Елизаров
Nov 23 '18 at 10:51
I suppose you're usingconnection = cx_Oracle.connect('username/pwd@DBdns:1521/DBsid'), aren't you ..?
– Barbaros Özhan
Nov 24 '18 at 22:41
Which version of Python are you using?
sys.maxsize returns 9223372036854775807 for me.– Glazbee
Nov 23 '18 at 10:45
Which version of Python are you using?
sys.maxsize returns 9223372036854775807 for me.– Glazbee
Nov 23 '18 at 10:45
I am using python 3.6.2
– Михаил Елизаров
Nov 23 '18 at 10:47
I am using python 3.6.2
– Михаил Елизаров
Nov 23 '18 at 10:47
I would recommend running Python in 64-bit. 32-bit Python returns
sys.maxsize as 2147483647, this is where you're running into errors.– Glazbee
Nov 23 '18 at 10:49
I would recommend running Python in 64-bit. 32-bit Python returns
sys.maxsize as 2147483647, this is where you're running into errors.– Glazbee
Nov 23 '18 at 10:49
I have 64-bit python. sys.maxsize returns
9223372036854775807– Михаил Елизаров
Nov 23 '18 at 10:51
I have 64-bit python. sys.maxsize returns
9223372036854775807– Михаил Елизаров
Nov 23 '18 at 10:51
I suppose you're using
connection = cx_Oracle.connect('username/pwd@DBdns:1521/DBsid'), aren't you ..?– Barbaros Özhan
Nov 24 '18 at 22:41
I suppose you're using
connection = cx_Oracle.connect('username/pwd@DBdns:1521/DBsid'), aren't you ..?– Barbaros Özhan
Nov 24 '18 at 22:41
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53445076%2fbig-int-values-from-oracle-sql-database-become-negative-after-reading-sql-in-df%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53445076%2fbig-int-values-from-oracle-sql-database-become-negative-after-reading-sql-in-df%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Which version of Python are you using?
sys.maxsizereturns9223372036854775807for me.– Glazbee
Nov 23 '18 at 10:45
I am using python 3.6.2
– Михаил Елизаров
Nov 23 '18 at 10:47
I would recommend running Python in 64-bit. 32-bit Python returns
sys.maxsizeas2147483647, this is where you're running into errors.– Glazbee
Nov 23 '18 at 10:49
I have 64-bit python. sys.maxsize returns
9223372036854775807– Михаил Елизаров
Nov 23 '18 at 10:51
I suppose you're using
connection = cx_Oracle.connect('username/pwd@DBdns:1521/DBsid'), aren't you ..?– Barbaros Özhan
Nov 24 '18 at 22:41