python (12.9k questions)

javascript (9.2k questions)

reactjs (4.7k questions)

java (4.2k questions)

java (4.2k questions)

c# (3.5k questions)

c# (3.5k questions)

html (3.3k questions)

Questions - delimiter

Prevent commas in open text columns from messing up spark read csv

I have a directory of CSVs that has some text columns that DO NOT have quotes around them (I cannot control this as these are from an external source). These open text columns have commas in them and...
test-img

ben890

csv

apache-spark

pyspark

apache-spark-sql

delimiter

Votes: 0

Answers: 1

Latest Answer

I agree with @blackbishop. There is no magic to read this type of data without any string manipulation. That's sort of why I asked what is after Note column. Only way to handle is to either change the...
test-img

Emma

Split each line in a file based on delimitters

This is the sample data in a file. I want to split each line in the file and add to a dataframe. In some cases they have more than 1 child. So whenever they have more than one child new set of column ...
test-img

niharika gadde

python

split

nlp

delimiter

Votes: 0

Answers: 1

Latest Answer

I'm not sure if you want it as a list or something else. To get lists: result = [] for t in text[:]: # remove the \n at the end of each line t = t.strip() # remove the parenthesis you don...
test-img

Ssayan

How do I split a line via a delimiter?

I have a dataframe. [1] Question 1. What is your name? Question 2. Where do you live? Question 3. ~~~ [2] Question 1. What are your hobbies? Question 2. What is your school? Question 3. ~~~ I...
test-img

Yun

r

regex

split

delimiter

Votes: 0

Answers: 2

Latest Answer

Using strsplit and lookarounds, trimws afterwards. strsplit(x, '(?<=\\s)(?=Question)', perl=TRUE) |> lapply(trimws) # [[1]] # [1] "Question 1. What is your name?" "Question 2. W...
test-img

jay.sf

awk BEGIN insert new column to .txt without overwriting existing file data, include new column header and convert to csv

I have a file vols.txt like this: LabelID Mean StdD Max Min Count Vol(mm^3) Extent(Vox) 0 0.00000 0.00000 0.00000 0.00000 141218...
test-img

Coco Newton

csv

awk

delimiter

txt

Votes: 0

Answers: 3

Latest Answer

$ awk -v OFS=, '{$1=(NR==1?"subjectID":25000) OFS $1}1' file subjectID,LabelID,Mean,StdD,Max,Min,Count,Vol(mm^3),Extent(Vox) 25000,0,0.00000,0.00000,0.00000,0.00000,14121856,2973312.714,51...
test-img

karakfa

Posts

Questions

Blogs

Jobs