[uplug] Dateisystem / Performancetuning

daholm at web.de daholm at web.de
Do Aug 2 09:44:55 CEST 2007


Hallo Liste,

> dein Vorhaben klingt interessant. Würdest Du Deine Ergebnisse bitte hier
> posten.

So lange gewartet, endlich ein Ergebnis. Weiß zwar nicht ob es als
Referenz anführbar ist, doch tut euch keinen Zwang an.

> hinweis: so weit ich weiß, unterstützen ReiserFS4 und XFS sparse files.
> evtl werden schreibvorgänge von \0en wegoptimiert ... also nimm andere
> daten.

Darauf habe ich per Postmark leider keinen Einfluss. Das Tool geht feste
Abläufe durch, die vorher nur in Zahl und Wiederholung konfigurierbar
sind. Inhaltlich war da leider nichts zu skalieren.

Vorweg eine kleine Inhaltsübersicht:

1. XFS/REISER/EXT3 (7.2K IDE)
2. XFS/REISER/EXT3 (15K SCSI)
3. XFS/REISER/EXT3 (15K SCSI) mit neuen Testparametern -> dient als
Vergleichswert zu 2
4. EXT3 in den 3 data-modi journal, writeback, dir_index

========================================================
1, 2 und 4 haben idnetische Parameterkonfigurationen

Alle Tests wurden mit folgenden Einstellungen gemacht:

Dateigröß0e von bis > set size 1500 15000
Dateianzahl > set number 125000
Schreibvorgänge > set transactions 1000000
Verzeichnisanzahl > set subdirectories 10000

3 bekam als Altervergleich höhere Parameter

set size 1500 15000
set number 500000
set transactions 2000000
set subdirectories 50

=========================================================

Dann werd ich mal loslegen.

=========================================================
1      der Test von XFS/REISER/EXT3 auf einer 7.2K Platte
=========================================================

Ergebnisse:

7.2k IDE Festplatte EXT3
========================

PostMark v1.51 : 8/14/01
Reading configuration from file 'ext3'
Creating subdirectories...Done
Creating files...Done
Performing transactions..........Done
Deleting files...Done
Deleting subdirectories...Done
Time:
        21549 seconds total
        21124 seconds of transactions (47 per second)

Files:
        624927 created (29 per second)
                Creation alone: 125000 files (706 per second)
                Mixed with transactions: 499927 files (23 per second)
        499921 read (23 per second)
        498032 appended (23 per second)
        624927 deleted (29 per second)
                Deletion alone: 124854 files (503 per second)
                Mixed with transactions: 500073 files (23 per second)

Data:
        4825.97 megabytes read (229.33 kilobytes per second)
        6076.41 megabytes written (288.75 kilobytes per second)

7.2k IDE Festplatte REISER
==========================

PostMark v1.51 : 8/14/01
Reading configuration from file 'reiser'
Creating subdirectories...Done
Creating files...Done
Performing transactions..........Done
Deleting files...Done
Deleting subdirectories...Done
Time:
        25152 seconds total
        24190 seconds of transactions (41 per second)

Files:
        624927 created (24 per second)
                Creation alone: 125000 files (192 per second)
                Mixed with transactions: 499927 files (20 per second)
        499921 read (20 per second)
        498032 appended (20 per second)
        624927 deleted (24 per second)
                Deletion alone: 124854 files (400 per second)
                Mixed with transactions: 500073 files (20 per second)

Data:
        4825.97 megabytes read (196.48 kilobytes per second)
        6076.41 megabytes written (247.39 kilobytes per second)


7.2k IDE Festplatte XFS
=======================

PostMark v1.51 : 8/14/01
Reading configuration from file 'xfs'
Creating subdirectories...Done
Creating files...Done
Performing transactions..........Done
Deleting files...Done
Deleting subdirectories...Done
Time:
        40889 seconds total
        38354 seconds of transactions (26 per second)

Files:
        624927 created (15 per second)
                Creation alone: 125000 files (155 per second)
                Mixed with transactions: 499927 files (13 per second)
        499921 read (13 per second)
        498032 appended (12 per second)
        624927 deleted (15 per second)
                Deletion alone: 124854 files (72 per second)
                Mixed with transactions: 500073 files (13 per second)

Data:
        4825.97 megabytes read (120.86 kilobytes per second)
        6076.41 megabytes written (152.17 kilobytes per second)


=========================================================
2  der Test von XFS/REISER/EXT3 auf einer 15K SCSI Platte
=========================================================

Ergebnisse:

15k SCSI Festplatte EXT3
========================

PostMark v1.51 : 8/14/01
Reading configuration from file 'ext3'
Creating subdirectories...Done
Creating files...Done
Performing transactions..........Done
Deleting files...Done
Deleting subdirectories...Done
Time:
	6420 seconds total
	6165 seconds of transactions (162 per second)

Files:
	624927 created (97 per second)
		Creation alone: 125000 files (1225 per second)
		Mixed with transactions: 499927 files (81 per second)
	499921 read (81 per second)
	498032 appended (80 per second)
	624927 deleted (97 per second)
		Deletion alone: 124854 files (816 per second)
		Mixed with transactions: 500073 files (81 per second)

Data:
	4825.97 megabytes read (769.75 kilobytes per second)
	6076.41 megabytes written (969.20 kilobytes per second)


15k SCSI Festplatte REISERFS
============================

PostMark v1.51 : 8/14/01
Reading configuration from file 'reiser'
Creating subdirectories...Done
Creating files...Done
Performing transactions..........Done
Deleting files...Done
Deleting subdirectories...Done
Time:
	8539 seconds total
	8100 seconds of transactions (123 per second)

Files:
	624927 created (73 per second)
		Creation alone: 125000 files (411 per second)
		Mixed with transactions: 499927 files (61 per second)
	499921 read (61 per second)
	498032 appended (61 per second)
	624927 deleted (73 per second)
		Deletion alone: 124854 files (924 per second)
		Mixed with transactions: 500073 files (61 per second)

Data:
	4825.97 megabytes read (578.73 kilobytes per second)
	6076.41 megabytes written (728.69 kilobytes per second)

15k SCSI Festplatte XFS
=======================

PostMark v1.51 : 8/14/01
Reading configuration from file 'xfs'
Creating subdirectories...Done
Creating files...Done
Performing transactions..........Done
Deleting files...Done
Deleting subdirectories...Done
Time:
	13325 seconds total
	12341 seconds of transactions (81 per second)

Files:
	624927 created (46 per second)
		Creation alone: 125000 files (457 per second)
		Mixed with transactions: 499927 files (40 per second)
	499921 read (40 per second)
	498032 appended (40 per second)
	624927 deleted (46 per second)
		Deletion alone: 124854 files (175 per second)
		Mixed with transactions: 500073 files (40 per second)

Data:
	4825.97 megabytes read (370.87 kilobytes per second)
	6076.41 megabytes written (466.96 kilobytes per second)


=========================================================
3  der Test von XFS/REISER/EXT3 auf einer 15K SCSI Platte
mit neuen Einstellungen, als Vergleichswert
=========================================================

EXT3 15k SCSI
=============
PostMark v1.51 : 8/14/01
Reading configuration from file 'config'
Creating subdirectories...Done
Creating files...Done
Performing transactions..........Done
Deleting files...Done
Deleting subdirectories...Done
Time:
	22425 seconds total
	21946 seconds of transactions (91 per second)

Files:
	1498932 created (66 per second)
		Creation alone: 500000 files (4424 per second)
		Mixed with transactions: 998932 files (45 per second)
	999980 read (45 per second)
	998158 appended (45 per second)
	1498932 deleted (66 per second)
		Deletion alone: 497864 files (1360 per second)
		Mixed with transactions: 1001068 files (45 per second)

Data:
	9336.51 megabytes read (426.34 kilobytes per second)
	14264.72 megabytes written (651.37 kilobytes per second)

XFS 15k SCSI
============
PostMark v1.51 : 8/14/01
Reading configuration from file 'config'
Creating subdirectories...Done
Creating files...Done
Performing transactions..........Done
Deleting files...Done
Deleting subdirectories...Done
Time:
	50950 seconds total
	44113 seconds of transactions (45 per second)

Files:
	1498932 created (29 per second)
		Creation alone: 500000 files (209 per second)
		Mixed with transactions: 998932 files (22 per second)
	999980 read (22 per second)
	998158 appended (22 per second)
	1498932 deleted (29 per second)
		Deletion alone: 497864 files (111 per second)
		Mixed with transactions: 1001068 files (22 per second)

Data:
	9336.51 megabytes read (187.65 kilobytes per second)
	14264.72 megabytes written (286.69 kilobytes per second)

REISERFS 15k SCSI
=================

PostMark v1.51 : 8/14/01
Reading configuration from file 'config'
Creating subdirectories...Done
Creating files...Done
Performing transactions..........Done
Deleting files...Done
Deleting subdirectories...Done
Time:
	31309 seconds total
	29905 seconds of transactions (66 per second)

Files:
	1498932 created (47 per second)
		Creation alone: 500000 files (1396 per second)
		Mixed with transactions: 998932 files (33 per second)
	999980 read (33 per second)
	998158 appended (33 per second)
	1498932 deleted (47 per second)
		Deletion alone: 497864 files (475 per second)
		Mixed with transactions: 1001068 files (33 per second)

Data:
	9336.51 megabytes read (305.36 kilobytes per second)
	14264.72 megabytes written (466.55 kilobytes per second)

=========================================================
4  EXT3  in den 3 data-modi journal, writeback, dir_index
=========================================================

data=dir_index
=============

PostMark v1.51 : 8/14/01
Reading configuration from file 'config'
Creating subdirectories...Done
Creating files...Done
Performing transactions..........Done
Deleting files...Done
Deleting subdirectories...Done
Time:
	21454 seconds total
	20943 seconds of transactions (95 per second)

Files:
	1498932 created (69 per second)
		Creation alone: 500000 files (4065 per second)
		Mixed with transactions: 998932 files (47 per second)
	999980 read (47 per second)
	998158 appended (47 per second)
	1498932 deleted (69 per second)
		Deletion alone: 497864 files (1283 per second)
		Mixed with transactions: 1001068 files (47 per second)

Data:
	9336.51 megabytes read (445.63 kilobytes per second)
	14264.72 megabytes written (680.86 kilobytes per second)

data=writeback
==============

PostMark v1.51 : 8/14/01
Reading configuration from file 'config'
Creating subdirectories...Done
Creating files...Done
Performing transactions..........Done
Deleting files...Done
Deleting subdirectories...Done
Time:
	22817 seconds total
	21849 seconds of transactions (91 per second)

Files:
	1498932 created (65 per second)
		Creation alone: 500000 files (846 per second)
		Mixed with transactions: 998932 files (45 per second)
	999980 read (45 per second)
	998158 appended (45 per second)
	1498932 deleted (65 per second)
		Deletion alone: 497864 files (1320 per second)
		Mixed with transactions: 1001068 files (45 per second)

Data:
	9336.51 megabytes read (419.01 kilobytes per second)
	14264.72 megabytes written (640.18 kilobytes per second)

data=journal
============

PostMark v1.51 : 8/14/01
Reading configuration from file 'config'
Creating subdirectories...Done
Creating files...Done
Performing transactions..........Done
Deleting files...Done
Deleting subdirectories...Done
Time:
	22930 seconds total
	22099 seconds of transactions (90 per second)

Files:
	1498932 created (65 per second)
		Creation alone: 500000 files (1160 per second)
		Mixed with transactions: 998932 files (45 per second)
	999980 read (45 per second)
	998158 appended (45 per second)
	1498932 deleted (65 per second)
		Deletion alone: 497864 files (1244 per second)
		Mixed with transactions: 1001068 files (45 per second)

Data:
	9336.51 megabytes read (416.95 kilobytes per second)
	14264.72 megabytes written (637.03 kilobytes per second)




Mehr Informationen über die Mailingliste upLUG