Autor Thema: Copy of LN DB differs in size  (Gelesen 6907 mal)

Offline booltrue

  • Frischling
  • *
  • Beiträge: 42
Copy of LN DB differs in size
« am: 12.02.19 - 14:49:14 »

I have a 50GB DB on the server, when I do a copy on the server or even a local copy the size is only about 35GB
I figured out that issue long time ago, but for huge DB's it's quite a lot of memory space.

Is there any reason for that issue? The blocksize on the system should not cause such a huge memory space difference.

Offline Peter Klett

  • Gold Platin u.s.w. member:)
  • *****
  • Beiträge: 2.713
  • Geschlecht: Männlich
Re: Copy of LN DB differs in size
« Antwort #1 am: 12.02.19 - 15:09:20 »
The views need space. Open the copy and you will see that the database becomes bigger

Offline Tode

  • Moderatoren
  • Gold Platin u.s.w. member:)
  • *****
  • Beiträge: 6.885
  • Geschlecht: Männlich
  • Geht nicht, gibt's (fast) nicht... *g*
Re: Copy of LN DB differs in size
« Antwort #2 am: 12.02.19 - 16:05:59 »
The database size consists of:

1. Data in documents
2. Size of Design elements
3. View indexes
4. White space

When you create a new copy only 1. and 2. are the same (although the copy might have / not have document and design compression active, what can make a difference).
3. is built on usage (every view you open will increase the size of your database and every sortable column you click as well)
4. will be reduced automatically when creating a copy (as white space is not copied).

I am quite sure that Peter is right: in a big application view indexes can be almost as big as the data itself.
Gruss
Torsten (Tode)

P.S.: Da mein Nickname immer mal wieder für Verwirrung sorgt: Tode hat NICHTS mit Tod zu tun. So klingt es einfach, wenn ein 2- Jähriger versucht "Torsten" zu sagen... das klingt dann so: "Tooode" (langes O, das r, s und n werden verschluckt, das t wird zum badischen d)

Offline booltrue

  • Frischling
  • *
  • Beiträge: 42
Re: Copy of LN DB differs in size
« Antwort #3 am: 12.02.19 - 16:31:25 »

I just tried to reproduce what both of you said.
I opened all views, clicked on each columns (all are sortable) and opened several documents,
but the size of the database is still the same. It didnt grow up, same as the original one
%used shows 99.9%

Offline Tode

  • Moderatoren
  • Gold Platin u.s.w. member:)
  • *****
  • Beiträge: 6.885
  • Geschlecht: Männlich
  • Geht nicht, gibt's (fast) nicht... *g*
Re: Copy of LN DB differs in size
« Antwort #4 am: 12.02.19 - 16:52:03 »
What about ODS? Are they both the same ODS?
Gruss
Torsten (Tode)

P.S.: Da mein Nickname immer mal wieder für Verwirrung sorgt: Tode hat NICHTS mit Tod zu tun. So klingt es einfach, wenn ein 2- Jähriger versucht "Torsten" zu sagen... das klingt dann so: "Tooode" (langes O, das r, s und n werden verschluckt, das t wird zum badischen d)

Offline Ralf_B

  • Aktives Mitglied
  • ***
  • Beiträge: 144
  • Geschlecht: Männlich
Re: Copy of LN DB differs in size
« Antwort #5 am: 12.02.19 - 17:04:57 »
Well, also try to rebuild all views(ctrl+shift+F9) or open also the hidden views, the difference is most likely about the view index inside the database.
Compare %used  and the amount of documents between both databases.

The size for a copied / replicated DB depends also (except the already mentioned causes) on:

-  Index for views (if nisnsf is not used). 8)
- Cluster size of the drive where the DB is stored.
- Amount of Profile Documents
- Unread Tables entries
- If documents have reader fields and documents does not get copied.
- Deletion stubs
- Replication conflicts
- Database settings like compression .......
- If the attachments are stored inside the database.

In the past I expected that databases have had a lot of year old deletion stubs which where not get deleted, but they where not recreated if a copy of the DB was created .......  especially if the DB' is really old and was created with Notes Version prior to 5 or 4.

Offline Pyewacket

  • Senior Mitglied
  • ****
  • Beiträge: 310
  • Geschlecht: Männlich
Re: Copy of LN DB differs in size
« Antwort #6 am: 12.02.19 - 21:07:04 »
Does this behaviour apply to one specific databases or do
all of your databases of similar size behave the same?
ATOS.org - Feel the music!

Offline booltrue

  • Frischling
  • *
  • Beiträge: 42
Re: Copy of LN DB differs in size
« Antwort #7 am: 13.02.19 - 09:46:01 »

ODS version is same for both.

Also rebuilding the views didn't change the size of the copied db
source db size ~30GB, 49.5%used
copied db size ~16GB, 99.9%used
The amount of documents, unread documents and database settings are same for both dbs

Tried to remove the deletion stubs under the replication settings from the source db, but the size didn't change

The dbs are stored on the same cluster on the server. I also tried with local copies, but the same behaviour.

The behaviour applies to all other dbs same, even with only one view and size of ~60MB -> copied db size 2MB

Zitat
In the past I expected that databases have had a lot of year old deletion stubs which where not get deleted, but they where not recreated if a copy of the DB was created
Could be the problem, but how to remove the deletion stubs, that apparently will not be recreated after copying



Offline Tode

  • Moderatoren
  • Gold Platin u.s.w. member:)
  • *****
  • Beiträge: 6.885
  • Geschlecht: Männlich
  • Geht nicht, gibt's (fast) nicht... *g*
Re: Copy of LN DB differs in size
« Antwort #8 am: 13.02.19 - 10:03:20 »
ARE YOU SERIOUS?????

source db size ~30GB, 49.5%used
copied db size ~16GB, 99.9%used

What do you think, does "49.5% used" mean? Just compact the database with -c or -B to release the unused space...
Gruss
Torsten (Tode)

P.S.: Da mein Nickname immer mal wieder für Verwirrung sorgt: Tode hat NICHTS mit Tod zu tun. So klingt es einfach, wenn ein 2- Jähriger versucht "Torsten" zu sagen... das klingt dann so: "Tooode" (langes O, das r, s und n werden verschluckt, das t wird zum badischen d)

Offline booltrue

  • Frischling
  • *
  • Beiträge: 42
Re: Copy of LN DB differs in size
« Antwort #9 am: 13.02.19 - 10:10:18 »
Ok, thanks.

Does compact can only be done from the console, or also from the database settings with "compress" ?


Offline Tode

  • Moderatoren
  • Gold Platin u.s.w. member:)
  • *****
  • Beiträge: 6.885
  • Geschlecht: Männlich
  • Geht nicht, gibt's (fast) nicht... *g*
Re: Copy of LN DB differs in size
« Antwort #10 am: 13.02.19 - 10:27:56 »
Yes, compress also works, if the database is not in use by somebody.
Gruss
Torsten (Tode)

P.S.: Da mein Nickname immer mal wieder für Verwirrung sorgt: Tode hat NICHTS mit Tod zu tun. So klingt es einfach, wenn ein 2- Jähriger versucht "Torsten" zu sagen... das klingt dann so: "Tooode" (langes O, das r, s und n werden verschluckt, das t wird zum badischen d)

Offline booltrue

  • Frischling
  • *
  • Beiträge: 42
Re: Copy of LN DB differs in size
« Antwort #11 am: 14.02.19 - 10:16:45 »

Danke!

Weiß gar nicht warum ich die ganze Zeit englisch schreibe  :-:

 

Impressum Atnotes.de  -  Powered by Syslords Solutions  -  Datenschutz