Skip to main content

This site requires you to update your browser. Your browsing experience maybe affected by not having the most up to date version.

We've moved the forum!

Please use forum.silverstripe.org for any new questions (announcement).
The forum archive will stick around, but will be read only.

You can also use our Slack channel or StackOverflow to ask for help.
Check out our community overview for more options to contribute.

Data Model Questions /

Moderators: martimiz, Sean, Ed, biapar, Willr, Ingo, swaiba

Large number of files - are there plans to fix this?


Go to End


5 Posts   1335 Views

Avatar
Darren Inwood

Community Member, 12 Posts

1 December 2011 at 11:51am

Hi list

I've had a good Google but not found anything definitive, so I'll ask for some general comments here. :-)

SS has long had an issue with Files & Images when there are a large number of files. Any server has a finite amount of resources, but users can add an unlimited number of files; so given enough files to process, regardless of how much RAM and execution time you throw at the problem, operations on folders can die midway, leaving the File table out of sync.

Are there any plans to move operations like these to offline processes?

Any advice or info appreciated!
--
Darren

Avatar
Darren Inwood

Community Member, 12 Posts

18 January 2012 at 2:29pm

This is about to cost us a major customer, can anybody at SilverStripe comment on whether or not any changes to the way Files are processed are planned?

Avatar
swaiba

Forum Moderator, 1899 Posts

18 January 2012 at 11:21pm

If you didn't get a response and this is so urgent I'd raise it as a critical issue ont he open.silverstripe.org and hang out in NZ time on IRC to catch a silverstripe person to address this.

Avatar
Willr

Forum Moderator, 5523 Posts

20 January 2012 at 4:13pm

Are there any plans to move operations like these to offline processes?

I had a look through the road map and can't see anything like this planned, couple performance related tickets (e.g http://open.silverstripe.org/ticket/6534)

Avatar
Darren Inwood

Community Member, 12 Posts

20 January 2012 at 4:30pm

Thanks Willr, I'll have to have a squiz through the ORM stuff for 3.0 and see if there's anything in there for really large dataobjectsets. :)