Sort, Orderby

[patrick]

Not

 

[patrick]

No, you have not resolved the problem. Very shortly you are going to reply or open a new thread that you are using too much memory because as I recall you have 43 columns and enough rows to fill up 10 GB. All of that will have to be loaded into memory to use the LINQ OrderBy().

As I told @Anwind, doing a code migration has nothing to do with changing from using SQLite to switch to using the ACE, JET, or Sylvan CSV reader. Since at one time you see considering using ACE or JET, that means that your target platform is Windows. Since SQLite works on Windows, you are actually losing functionality by reading straight from the CSV instead importing the data into SQLite. Furthermore, she/you are now imposing a "usage" tax on your users. Instead of paying the one time cost of importing the data into SQLite, now your users have to pay the cost of always reading from the CSV all into memory and sorting every time.

All of that will have to be loaded into memory to use the LINQ OrderBy().
==> CSV File Size : 598,139KB, 800,000 Row, 43 Column
I ran it with your code, It seems to require a lot of memory.

Your Answer) All of that will have to be loaded into memory
==> What should I do?

 

[Skydiver]

It's not my code. It was your code from a post that you have since deleted. You kept on believing that the syntax was incorrect. I just did that screenshot to show you that your code was syntactically correct and that you were obsessing over the wrong thing.

 

[Skydiver]

Your Answer) All of that will have to be loaded into memory
==> What should I do?

I told you already on another one of your multiple threads: re-open your algorithms and data structures book and learn how to implement external sorting.

Or get rid of your requirement that the entire CSV not be loaded into memory.

Or go back to using a database like SQLite that is really good at returning data in a particular order.

 

[cjard]

Skydiver, are you talking to yourself again?

Surely it must be possible to take away a member's delete privs..

 

[Skydiver]

Shhh... Don't tell anyone. With all these red flag laws, they might take my guns, bows, knives, and nerf weapons away.

Seriously, though, the Neal has reviewed settings and fixed a few things.

 

[patrick]

I told you already on another one of your multiple threads: re-open your algorithms and data structures book and learn how to implement external sorting.

Or get rid of your requirement that the entire CSV not be loaded into memory.

Or go back to using a database like SQLite that is really good at returning data in a particular order.

I still haven't solved the memory problem. The entire CSV must be loaded into memory.

 

[cjard]

And I can't remember what the problem was (I have a memory problem too), and you deleted all your past posts that might have given a clue as to what it was..