mongodb - WiredTiger - “too many open files error” during resync of a secondary replica set member -

-

i'm upgrading secondary replica set member wiredtiger. have upgraded mongodb 2.6.3 3.0.4 , changed storage engine wiredtiger. resyncing data primary. @ point following error received, , process starts on again:

2015-07-22t13:18:55.658+0000 index [rssync] building index using bulk method

2015-07-22t13:18:55.664+0000 index [rssync] build index done. scanned 1591 total records. 0 secs

2015-07-22t13:18:56.397+0000 e storage [rssync] wiredtiger (24) [1437571136:397083][20413:0x7f3d9ed29700], file:wiredtiger.wt, session.create: wiredtiger.turtle: fopen: many open files

2015-07-22t13:18:56.463+0000 e repl [rssync] 8 24: many open files

2015-07-22t13:18:56.463+0000 e repl [rssync] initial sync attempt failed, 9 attempts remaining

the same machine running 2.6.3 version without open file limits issues. i'm aware wiredtiger might creating more files, must it, keep them open simultaneously ?

for reference:

cat /proc/sys/fs/file-max

10747371

in /etc/init.d/mongod configuration is:

ulimit -n 64000

according documentation seems mongo holds file descriptor every data file. in wiredtiger results in file each collection + file each index, according calculation our usecase, can add on 700k.

so can change ulimit 700000 or higher, i'm wondering whether correct solution, , alternatives exist.

wiredtiger clean open file descriptors based on how long have been idle, during heavy activity across large number of collections , indexes going end bounded ulimit on open files.

so, yes, need increase limit until no longer hit problem, stick mmapv1, or consolidate collections. recommend filing feature request outlining use case sample numbers way prevent type of pattern (more 1 collection per file example).


Comments

Post a Comment

Popular posts from this blog

python - pip install -U PySide error -

-
does know how avoid following error when running pip install -u pyside per official website instructions here: https://pypi.python.org/pypi/pyside/#installing-pyside-on-a-mac-os-x-system note have done brew install qt successfully. you using pip version 7.0.3, version 7.1.2 available. should consider upgrading via 'pip install --upgrade pip' command. collecting pyside using cached pyside-1.2.4.tar.gz installing collected packages: pyside running setup.py install pyside complete output command /applications/anaconda/bin/python -c "import setuptools, tokenize;__file__='/private/var/folders/dy/ttgqhqqx3g9bsbsnqnxsk2z80000gq/t/pip-build-cpxemt/pyside/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /var/folders/dy/ttgqhqqx3g9bsbsnqnxsk2z80000gq/t/pip-0r7hri-record/install-record.txt --single-version-externally-managed --compile: ...
Read more

arrays - C++ error: a brace-enclosed initializer is not allowed here before ‘{’ token -

-
simple question: i'm trying initialize array within c++ class declaration: using namespace std; #include <string> class myclass{ public: string myarray[] = {"a","b","c"}; }; and i'm getting error: error: brace-enclosed initializer not allowed here before ‘{’ token no, without complied c++11 compiler, cannot initialize member array in declaration. have initialize array member in constructor. , don't use open array if know number of elements initialize array.
Read more

cytoscape.js - How to add nodes to Dagre layout with Cytoscape -

-
i trying add nodes dagre graph through cityscape.js. problem nodes not painted. code have: cy.add({ group: "nodes", data: { id:"n0",name:"n0",weight: 75 }, }); $.ajax(url).done(function(jsontree){ var newnodes=[]; for(var i=1;i<6;i++){ //var child = jsontree.result[i]; newnodes.push( { group: "nodes", data: { id: "n"+i, name:"n"+i}}, { group: "edges", data: { id: "e"+i, source: "n0", target: "n"+i } } ); } cy.add(newnodes); any ideas? have used loaded function reload graph not work. not know if have use specific function reload graph. thank in advance. you need add positions new nodes. cytoscape.js docs : it important note positions of newly added nodes must defined when calling cy.add(). nodes can not placed in graph without valid position — otherwise not displayed. yo...
Read more